Hand-supportable digital image-processing based bar code symbol reading system employing image cropping zone (ICZ) framing and post-image capture cropping

ABSTRACT

A method of reading bar code symbols comprising the steps of: (a) projecting an image cropping zone (ICZ) framing pattern within the FOV of an image sensing array during wide-area illumination and image capturing operation; (b) visually aligning an object to be imaged within the ICZ framing pattern; (c) forming and capturing an wide-area image of the entire FOV, which spatially encompasses the ICZ framing pattern aligned about the object to be imaged; (d) using automatic software-based image cropping algorithm to automatically crop the pixels within the spatial boundaries defined by the ICZ framing pattern, from those pixels contained in the entire wide-area image frame captured during step (c); and (e) automatically decode processing the image represented by the cropped image pixels in the ICZ framing pattern so as to read a 1D or 2D bar code symbol graphically represented therein.

RELATED CASES

This application is a Continuation of U.S. application Ser. No.10/989,220 filed Nov. 15, 2004, now U.S. Pat. No. 7,490,774; which is aContinuation-in-Part of the following Applications: U.S. applicationSer. No. 10/712,787 filed Nov. 13, 2003, now U.S. Pat. No. 7,128,266;Ser. No. 10/893,800 filed Jul. 16, 2004, now U.S. Pat. No. 7,273,180;Ser. No. 10/893,797 filed Jul. 16, 2004, now U.S. Pat. No. 7,188,770;Ser. No. 10/893,798 filed Jul. 16, 2004, now U.S. Pat. No. 7,185,817;Ser. No. 10/894,476 filed Jul. 16, 2004, now U.S. Pat. No. 7,178,733;Ser. No. 10/894,478 filed Jul. 19, 2004, now U.S. Pat. No. 7,357,325;Ser. No. 10/894,412 filed Jul. 19, 2004, now U.S. Pat. No. 7,213,762;Ser. No. 10/894,477 filed Jul. 19, 2004, now U.S. Pat. No. 7,360,7006;Ser. No. 10/895,271 filed Jul. 20, 2004, now U.S. Pat. No. 7,216,810;Ser. No. 10/895,811 filed Jul. 20, 2004, now U.S. Pat. No. 7,225,988;Ser. No. 10/897,390 filed Jul. 22, 2004, now U.S. Pat. No. 7,237,722;Ser. No. 10/897,389 filed Jul. 22, 2004, now U.S. Pat. No. 7,225,989;Ser. No. 10/901,463 filed Jul. 27, 2004, now U.S. Pat. No. 7,086,595;Ser. No. 10/901,426 filed Jul. 27, 2004, now U.S. Pat. No. 7,278,575;Ser. No. 10/901,446 filed Jul. 27, 2004, now U.S. Pat. No. 7,428,998;Ser. No. 10/901,461 filed Jul. 28, 2004, now U.S. Pat. No. 7,320,431;Ser. No. 10/901,429 filed Jul. 28, 2004, now U.S. Pat. No. 7,243,847;Ser. No. 10/901,427 filed Jul. 28, 2004, now U.S. Pat. No. 7,267,282;Ser. No. 10/901,445 filed Jul. 28, 2004, now U.S. Pat. No. 7,240,844;Ser. No. 10/901,428 filed Jul. 28, 2004, now U.S. Pat. No. 7,293,714;Ser. No. 10/902,709 filed Jul. 29, 2004, now U.S. Pat. No. 7,270,272;Ser. No. 10/901,914 filed Jul. 29, 2004, now U.S. Pat. No. 7,325,738;Ser. No. 10/902,710 filed Jul. 29, 2004, now U.S. Pat. No. 7,281,661;Ser. No. 10/909,270 filed Jul. 30, 2004, now U.S. Pat. No. 7,284,705;and Ser. No. 10/909,255 filed Jul. 30, 2004, now U.S. Pat. No.7,299,986; and Ser. No. 10/903,904 filed Jul. 30, 2004, now U.S. Pat.No. 7,255,279. Each said patent application is assigned to and commonlyowned by Metrologic Instruments, Inc. of Blackwood, N.J., and isincorporated herein by reference in its entirety.

BACKGROUND OF INVENTION

1. Field of Invention

The present invention relates to hand-supportable and portable area-typedigital bar code readers having diverse modes of digital imageprocessing for reading one-dimensional (1 D) and two-dimensional (2 D)bar code symbols, as well as other forms of graphically-encodedintelligence.

2. Brief Description of the State of the Art

The state of the automatic-identification industry can be understood interms of (i) the different classes of bar code symbologies that havebeen developed and adopted by the industry, and (ii) the kinds ofapparatus developed and used to read such bar code symbologiessymbologies in various user environments.

In general, there are currently three major classes of bar codesymbologies, namely: one dimensional (1 D) bar code symbologies, such asUPC/EAN, Code 39, etc.; 1 D stacked bar code symbologies, Code 49,PDF417, etc.; and two-dimensional (2 D) data matrix symbologies.

One Dimensional optical bar code readers are well known in the art.Examples of such readers include readers of the Metrologic Voyager®Series Laser Scanner manufactured by Metrologic Instruments, Inc. Suchreaders include processing circuits that are able to read onedimensional (1 D) linear bar code symbologies, such as the UPC/EAN code,Code 39, etc., that are widely used in supermarkets. Such 1 D linearsymbologies are characterized by data that is encoded along a singleaxis, in the widths of bars and spaces, so that such symbols can be readfrom a single scan along that axis, provided that the symbol is imagedwith a sufficiently high resolution along that axis.

In order to allow the encoding of larger amounts of data in a single barcode symbol, a number of 1 D stacked bar code symbologies have beendeveloped, including Code 49, as described in U.S. Pat. No. 4,794,239(Allais), and PDF417, as described in U.S. Pat. No. 5,340,786 (Pavlidis,et al.). Stacked symbols partition the encoded data into multiple rows,each including a respective 1 D bar code pattern, all or most of all ofwhich must be scanned and decoded, then linked together to form acomplete message. Scanning still requires relatively high resolution inone dimension only, but multiple linear scans are needed to read thewhole symbol.

The third class of bar code symbologies, known as 2 D matrix symbologiesoffer orientation-free scanning and greater data densities andcapacities than their 1 D counterparts. In 2 D matrix codes, data isencoded as dark or light data elements within a regular polygonalmatrix, accompanied by graphical finder, orientation and referencestructures. When scanning 2 D matrix codes, the horizontal and verticalrelationships of the data elements are recorded with about equalresolution.

In order to avoid having to use different types of optical readers toread these different types of bar code symbols, it is desirable to havean optical reader that is able to read symbols of any of these types,including their various subtypes, interchangeably and automatically.More particularly, it is desirable to have an optical reader that isable to read all three of the above-mentioned types of bar code symbols,without human intervention, i.e., automatically. This in turn requiresthat the reader have the ability to automatically discriminate betweenand decode bar code symbols, based only on information read from thesymbol itself. Readers that have this ability are referred to as“auto-discriminating” or having an “auto-discrimination” capability.

If an auto-discriminating reader is able to read only 1 D bar codesymbols (including their various subtypes), it may be said to have a 1 Dauto-discrimination capability. Similarly, if it is able to read only 2D bar code symbols, it may be said to have a 2 D auto-discriminationcapability. If it is able to read both 1 D and 2 D bar code symbolsinterchangeably, it may be said to have a 1 D/2 D auto-discriminationcapability. Often, however, a reader is said to have a 1 D/2 Dauto-discrimination capability even if it is unable to discriminatebetween and decode 1 D stacked bar code symbols.

Optical readers that are capable of 1 D auto-discrimination are wellknown in the art. An early example of such a reader is Metrologic'sVoyagerCG® Laser Scanner, manufactured by Metrologic Instruments, Inc.

Optical readers, particularly hand held optical readers, that arecapable of 1 D/2 D auto-discrimination and based on the use of anasynchronously moving 1 D image sensor, are described in U.S. Pat. Nos.5,288,985 and 5,354,977, which applications are hereby expresslyincorporated herein by reference. Other examples of hand held readers ofthis type, based on the use of a stationary 2 D image sensor, aredescribed in U.S. Pat. Nos. 6,250,551; 5,932,862; 5,932,741; 5,942,741;5,929,418; 5,914,476; 5,831,254; 5,825,006; 5,784,102, which are alsohereby expressly incorporated herein by reference.

Optical readers, whether of the stationary or movable type, usuallyoperate at a fixed scanning rate, which means that the readers aredesigned to complete some fixed number of scans during a given amount oftime. This scanning rate generally has a value that is between 30 and200 scans/sec for 1 D readers. In such readers, the results of thesuccessive scans are decoded in the order of their occurrence.

Imaging-based bar code symbol readers have a number of advantages overlaser scanning based bar code symbol readers, namely: they are morecapable of reading stacked 2 D symbologies, such as the PDF 417symbology; more capable of reading matrix 2 D symbologies, such as theData Matrix symbology; more capable of reading bar codes regardless oftheir orientation; have lower manufacturing costs; and have thepotential for use in other applications, which may or may not be relatedto bar code scanning, such as OCR, security systems, etc

Prior art imaging-based bar code symbol readers suffer from a number ofadditional shortcomings and drawbacks.

Most prior art hand held optical reading devices can be reprogrammed byreading bar codes from a bar code programming menu or with use of alocal host processor as taught in U.S. Pat. No. 5,929,418. However,these devices are generally constrained to operate within the modes inwhich they have been programmed to operate, either in the field or onthe bench, before deployment to end-user application environments.Consequently, the statically-configured nature of such prior artimaging-based bar code reading systems has limited their performance.

Prior art imaging-based bar code symbol readers with integratedillumination subsystems also support a relatively short range of theoptical depth of field. This limits the capabilities of such systemsfrom reading big or highly dense bar code labels.

Prior art imaging-based bar code symbol readers generally require aseparate apparatus for producing a visible aiming beam to help the userto aim the camera's field of view at the bar code label on a particulartarget object.

Prior art imaging-based bar code symbol readers generally requirecapturing multiple frames of image data of a bar code symbol, and aspecial apparatus for synchronizing the decoding process with the imagecapture process within such readers, as required in U.S. Pat. Nos.5,932,862 and 5,942,741 assigned to Welch Allyn, Inc.

Prior art imaging-based bar code symbol readers generally require largearrays of LEDs in order to flood the field of view within which a barcode symbol might reside during image capture operations, oftentimeswasting large amounts of electrical power which can be significant inportable or mobile imaging-based readers.

Prior art imaging-based bar code symbol readers generally requireprocessing the entire pixel data set of capture images to find anddecode bar code symbols represented therein. On the other hand, someprior art imaging systems use the inherent programmable (pixel)windowing feature within conventional CMOS image sensors to capture onlypartial image frames to reduce pixel data set processing and enjoyimprovements in image processing speed and thus imaging systemperformance.

Many prior art imaging-based bar code symbol readers also require theuse of decoding algorithms that seek to find the orientation of bar codeelements in a captured image by finding and analyzing the code words of2-D bar code symbologies represented therein.

Some prior art imaging-based bar code symbol readers generally requirethe use of a manually-actuated trigger to actuate the image capture andprocessing cycle thereof.

Prior art imaging-based bar code symbol readers generally requireseparate sources of illumination for producing visible aiming beams andfor producing visible illumination beams used to flood the field of viewof the bar code reader.

Prior art imaging-based bar code symbol readers are generally utilizedduring a single image capture and processing cycle, and a singledecoding methodology for decoding bar code symbols represented incaptured images.

Some prior art imaging-based bar code symbol readers require exposurecontrol circuitry integrated with the image detection array formeasuring the light exposure levels on selected portions thereof.

Also, many imaging-based readers also require processing portions ofcaptured images to detect the image intensities thereof and determinethe reflected light levels at the image detection component of thesystem, and thereafter to control the LED-based illumination sources toachieve the desired image exposure levels at the image detector.

Prior art imaging-based bar code symbol readers employing integratedillumination mechanisms control image brightness and contrast bycontrolling the time the image sensing device is exposed to the lightreflected from the imaged objects. While this method has been proven forthe CCD-based bar code scanners, it is not suitable, however, for theCMOS-based image sensing devices, which require a more sophisticatedshuttering mechanism, leading to increased complexity, less reliabilityand, ultimately, more expensive bar code scanning systems.

Prior art imaging-based bar code symbol readers generally require theuse of tables and bar code menus to manage which decoding algorithms areto be used within any particular mode of system operation to beprogrammed by reading bar code symbols from a bar code menu.

Finally, as a result of limitations in the mechanical, electrical,optical, and software design of prior art imaging-based bar code symbolreaders, such prior art readers generally (i) fail to enable users toread high-density 1 D bar codes with the ease and simplicity of laserscanning based bar code symbol readers, and also 2 D symbologies, suchas PDF 417 and Data Matrix, and (ii) are incapable of use in OCR andOCV, security applications, etc.

Thus, there is a great need in the art for an improved method of andapparatus for reading bar code symbols using image capture andprocessing techniques which avoid the shortcomings and drawbacks ofprior art methods and apparatus.

OBJECTS AND SUMMARY OF THE PRESENT INVENTION

Accordingly, a primary object of the present invention is to provide anovel method of and apparatus for enabling the reading of 1 D and 2 Dbar code symbologies using image capture and processing based systemsand devices, which avoid the shortcomings and drawbacks of prior artmethods and apparatus.

Another object of the present invention is to provide a novelhand-supportable digital imaging-based bar code symbol reader capable ofautomatically reading 1 D and 2 D bar code symbologies using thestate-of-the art imaging technology, and at the speed and with thereliability achieved by conventional laser scanning bar code symbolreaders.

Another object of the present invention is to provide a novelhand-supportable digital imaging-based bar code symbol reader that iscapable of reading stacked 2 D symbologies such as PDF417, as well asData Matrix.

Another object of the present invention is to provide a novelhand-supportable digital imaging-based bar code symbol reader that iscapable of reading bar codes independent of their orientation withrespect to the reader.

Another object of the present invention is to provide a novelhand-supportable digital imaging-based bar code symbol reader thatutilizes an architecture that can be used in other applications, whichmay or may not be related to bar code scanning, such as OCR, OCV,security systems, etc.

Another object of the present invention is to provide a novelhand-supportable digital imaging-based bar code symbol reader that iscapable of reading high-density bar codes, as simply and effectively as“flying-spot” type laser scanners do.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader capable of reading 1 D and 2 D barcode symbologies in a manner as convenient to the end users as whenusing a conventional laser scanning bar code symbol reader.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader having a multi-mode bar code symbolreading subsystem, which is dynamically reconfigured in response toreal-time processing operations carried out on captured images.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader having an integrated LED-basedmulti-mode illumination subsystem for generating a visible narrow-areaillumination beam for aiming on a target object and illuminating a 1 Dbar code symbol aligned therewith during a narrow-area image capturemode of the system, and thereafter illuminating randomly-oriented 1 D or2 D bar code symbols on the target object during a wide-area imagecapture mode of the system.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing an integrated multi-modeillumination subsystem which generates a visible narrow-areaillumination beam for aiming onto a target object, which thenilluminates a 1 D bar code symbol aligned therewith, captures an imagethereof, and thereafter generates a wide-area illumination beam forilluminating 1 D or 2 D bar code symbols on the object and capturing animage thereof and processing the same to read the bar codes representedtherein.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing automatic object presenceand range detection to control the generation of near-field andfar-field wide-area illumination beams during bar code symbol imagingoperations.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing a CMOS-type image sensingarray using global exposure control techniques.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing a CMOS-type image sensingarray with a band-pass optical filter subsystem integrated within thehand-supportable housing thereof, to allow only narrow-band illuminationfrom the Multi-Mode Illumination Subsystem to expose the CMOS imagesensing array.

Another object of the present invention is to provide a hand-supportableimaging-based auto-discriminating 1 D/2 D bar code symbol readeremploying a multi-mode image-processing based bar code symbol readingsubsystem dynamically reconfigurable in response to real-time imageanalysis during bar code reading operations.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing a continuously operatingautomatic light exposure measurement and illumination control subsystem.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing a multi-mode led-basedillumination subsystem.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader having 1 D/2 D auto-discriminationcapabilities.

Another object of the present invention is to provide a method ofperforming auto-discrimination of 1 D/2 D bar code symbologies in animaging-based bar code symbol reader having both narrow-area andwide-area image capture modes of operation.

Another object of the present invention is to provide a method of andapparatus for processing captured images within an imaging-based barcode symbol reader in order to read (i.e. recognize) bar code symbolsgraphically represented therein.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing helically-sweepingfeature-extraction analysis on captured 2 D images of objects,referenced from the center thereof.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing simple image processingoperations applied in an outwardly-directed manner on capturednarrow-area images of objects bearing 1 D bar code symbols.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing an integrated LED-basedmulti-mode illumination subsystem with far-field and near-fieldillumination arrays responsive to control signals generated by anIR-based object presence and range detection subsystem during a firstmode of system operation and a system control subsystem during a secondmode of system operation.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing an integrated LED-basedmulti-mode illumination subsystem driven by an automatic light exposuremeasurement and illumination control subsystem responsive to controlactivation signals generated by a CMOS image sensing array and anIR-based object presence and range detection subsystem during objectillumination and image capturing operations.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing a CMOS image sensingarray which activates LED illumination driver circuitry to expose atarget object to narrowly-tuned LED-based illumination when all of therows of pixels in said CMOS image sensing array are in a state ofintegration, thereby capturing high quality images independent of therelative motion between said bar code reader and the target object.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader, wherein the exposure time ofnarrow-band illumination of the CMOS image sensing array is managed bycontrolling the illumination time of its LED-based illumination arraysusing control signals generated by an automatic light exposuremeasurement and illumination control subsystem and the CMOS imagesensing array while controlling narrow-band illumination thereto by wayof a band-pass optical filter subsystem.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing a mechanism ofcontrolling the image brightness and contrast by controlling the timethe illumination subsystem illuminates the target object, thus, avoidingthe need for a complex shuttering mechanism for CMOS-based image sensingarrays employed therein.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing a multi-modeimage-processing bar code symbol reading subsystem that automaticallyswitches its modes of reading during a single bar code symbol readingcycle, and a plurality of different bar code symbology decodingalgorithms are applied within each mode of reading.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader, wherein the multi-modeimage-processing symbol reading subsystem has a first multi-read (e.g.Omniscan/ROI-Specific) mode of operation, for adaptively processing anddecoding a captured high-resolution image in a high-speed manner,applying adaptive learning techniques.

Another object of the present invention is to provide such ahand-supportable imaging-based bar code symbol reader with a multi-modeimage-processing symbol reading subsystem having a first multi-read(e.g. Omniscan/ROI-Specific) mode of operation, wherein if during theOmniscan Mode of operation, code fragments associated with a PDF417 barcode symbol are detected within a ROI in a captured (narrow or wide)area image, but processing thereof is unsuccessful, then the multi-modeimage-processing symbol reading subsystem will automatically (i) enterits ROI-Specific Mode of operation described above, and then (ii)immediately commence processing of the captured image at the ROIspecified by ROI coordinates acquired by feature vector analysis duringthe Omniscan Mode of operation.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader with a multi-mode image-processingsymbol reading subsystem having a first multi-read (e.g.Omniscan/ROI-Specific) mode of operation, which offers an OmniScan Modeof operation to initially and rapidly read 1 D bar code symbologies, andvarious kinds of 2 D bar code symbologies whenever present in thecaptured image, and whenever a PDF417 symbology is detected (through itscode fragments), the multi-mode image-processing symbol readingsubsystem of the present invention can automatically switch (on-the-fly)to its ROI-specific Mode of operation to immediately processhigh-resolution image data at a specific ROI (at which there is a highlikelihood of a bar code symbol present).

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader, wherein its multi-modeimage-processing symbol reading subsystem has a second multi-read (e.g.NoFinder/ROI-Specific) mode of operation, for adaptively processing acaptured high-resolution image in a high-speed manner, applying adaptivelearning techniques.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader, wherein the multi-modeimage-processing symbol reading subsystem has a second multi-read (e.g.NoFinder/ROI-Specific) mode of operation, and wherein if during theNoFinder Mode of operation, code fragments associated with a PDF417 barcode symbol are detected within the captured wide-area image, but decodeprocessing thereof is unsuccessful, then the multi-mode image-processingsymbol reading subsystem will automatically (i) enter its ROI-specificmode of operation described above, and then (ii) immediately commenceprocessing of the captured wide-area image at a ROI specified by ycoordinates corresponding to the wide-area image processed during theNoFinder Mode of operation.

Another object of the present invention is to provide such ahand-supportable imaging-based bar code symbol reader, wherein itsmulti-mode image-processing symbol reading subsystem has a secondmulti-read (e.g. NoFinder/ROI-Specific) mode of operation, and whereinthe No-Finder Mode can rapidly read 1 D bar code symbologies wheneverthey are presented to the bar code symbol reader, and then whenever a 2D (e.g. PDF417) symbology is encountered, the bar code symbol reader canautomatically switch its method of reading to the ROI-specific Mode anduse features collected from a narrow (or wide) area image processedduring the No-Finder Mode, so as to immediately process a specific ROIin a captured wide-area image frame, at which there is a high likelihoodof a bar code symbol present, and to do so in a highly targeted manner.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader, wherein the Multi-ModeImage-Processing Bar Code Reading Subsystem has a third multi-read (e.g.NoFinder/Omniscan/ROI-Specific) mode of operation, for adaptivelyprocessing a captured high-resolution image in a high-speed manner,applying adaptive learning techniques.

Another object of the present invention is to provide such ahand-supportable imaging-based bar code symbol reader, wherein themulti-mode image-processing symbol reading subsystem has a thirdmulti-read (e.g. NoFinder/Omniscan/ROI-Specific) mode of operation, andwherein if during the NoFinder Mode of operation, code fragmentsassociated with a PDF417 bar code symbol are detected within thecaptured narrow-area image, but processing thereof is unsuccessful, thenthe image formation and detection subsystem (i) automatically captures awide-area image, while the multi-mode image-processing symbol readingsubsystem (ii) automatically enters its Omniscan Mode of operationdescribed above, and then (iii) immediately commences processing of thecaptured wide-area image at a plurality of parallel spatially-separated(e.g. by 50 pixels) virtual scan lines, beginning at a start pixel andstart angle specified by x and/or y coordinates of code fragmentsdetected in the narrow-area image processed during the NoFinder Mode ofoperation; and, if the Omniscan Mode does not successfully read a barcode symbol within the ROI, then the multi-mode image-processing symbolreading subsystem (i) automatically enters its ROI-specific mode ofoperation described above, and then (ii) immediately commencesprocessing of the captured wide-area image at an ROI specified by thex,y coordinates corresponding to code fragments detected in thewide-area image processed during the Omniscan Mode of operation.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader, wherein the multi-modeimage-processing symbol reading subsystem has a third multi-read (e.g.NoFinder/Omniscan/ROI-Specific) mode of operation, and wherein theNoFinder Mode can rapidly acquire 1 D bar code symbologies whenever theyare presented to the bar code symbol reader, and then whenever a 2 Dsymbology is encountered, the bar code symbol reader can automaticallyswitch its method of reading to the OmniScan Mode, collect features onprocessed image data, and if this reading method is not successful, thenthe bar code reader can automatically switch its method of reading tothe ROI-Specific Mode and use features collected during the OmniscanMode to immediately process a specific ROI in a captured image frame, atwhich there is a high likelihood of a bar code symbol present, and to doso in a highly targeted manner.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader having an integrated multi-modeillumination subsystem that supports an optical depth of field largerthan conventional imaging-based bar code symbol readers.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader having a Depth of Field (DOF) ofabout 0 mm to 200 mm (face to 8″) for 13.5 mil bar code symbols, whereinthe resolution varies as function of object distance, it can decode 5mil codes somewhere, its optics can resolve 4 mil codes somewhere, andit has a 45° Field of View (FOV).

Another object of the present invention is to provide an imaging-basedbar code symbol reader having a multi-mode image-processing based barcode symbol reading subsystem, which uses a set of features andconstructs a feature vector to determine a region of interest that maycontain a bar code.

Another object of the present invention is to provide an imaging-basedbar code symbol reader having a Multi-Mode Image-Processing Based BarCode Symbol Reading Subsystem which uses multiple, adaptive thresholdsto determine and mark regions of interest (ROIs).

Another object of the present invention is to provide an imaging-basedbar code symbol reader having a multi-mode image-processing based barcode symbol reading subsystem, which uses several image processingmethods to determine bar code orientation in a hierarchical scheme.

Another object of the present invention is to provide an imaging-basedbar code symbol reader having a multi-mode image-processing based barcode symbol reading subsystem, which uses several different scan-datafiltering techniques to generate bar-space counts.

Another object of the present invention is to provide an imaging-basedbar code symbol reader having a multi-mode image-processing based barcode symbol reading subsystem which uses bar and space stitching forcorrecting perspective and projection transforms, and also decodingdamaged labels.

Another object of the present invention is to provide an imaging-basedbar code symbol reader having a multi-mode image-processing based barcode symbol reading subsystem, which uses incremental processing ofimage data while an image is being progressively acquired.

Another object of the present invention is to provide an imaging-basedbar code symbol reader having a multi-mode image-processing based barcode symbol reading subsystem, which uses low-rise histogram analysis todetermine bright spots in captured images.

Another object of the present invention is to provide an imaging-basedbar code symbol reader having a multi-mode image-processing based barcode symbol reading subsystem, which detects all 1 D symbologies andPDF417 omnidirectionally.

Another object of the present invention is to provide an imaging-basedbar code symbol reader having a multi-mode image-processing based barcode symbol reading subsystem which decodes UPC/EAN, 1205, C128, C39,C93, CBR omnidirectionally.

Another object of the present invention is to provide an imaging-basedbar code symbol reader having a multi-mode image-processing based barcode symbol reading subsystem, which uses low incidence of“false-positives”

Another object of the present invention is to provide an imaging-basedbar code symbol reader having a multi-mode image-processing based barcode symbol reading subsystem, which works with images stored in memoryduring a snap-shot mode of operation.

Another object of the present invention is to provide an imaging-basedbar code symbol reader having a multi-mode image-processing based barcode symbol reading subsystem which works with images acquiredprogressively during an incremental mode of operation.

Another object of the present invention is to provide an imaging-basedbar code symbol reader having a multi-mode image-processing based barcode symbol reading subsystem which operates on captured high-resolutionimages having an image size of 32768×32768 pixels.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader which is simple to use, isinexpensive to manufacture, requires as few elements as possible, has anas small as possible form factor, employs no moving elements (i.e. nodynamic focus, and no zoom), and employs all spherical surfaces andcommon glasses.

Another object of the present invention is to provide a low-cost,high-resolution imaging-based bar code symbol reader foromni-directional reading of regular 1 D bar codes and two-dimensionalbar codes, such as the PDF417 symbology.

Another object of the present invention is to provide such animaging-based bar code symbol reader having target applications at pointof sales in convenience stores, gas stations, quick markets, and liquorstores, where 2 D bar code reading is required for age verification andthe like.

Another object of the present invention is to provide an improvedimaging-based bar code symbol reading engine for integration intodiverse types of information capture and processing systems, such as barcode driven portable data terminals (PDT) having wireless interfaceswith their base stations, reverse-vending machines, retail bar codedriven kiosks, and the like.

Another object of the present invention is to provide a novel method ofand apparatus for enabling global exposure control in an imaging-basedbar code symbol reader using a CMOS image sensing array.

Another object of the present invention is to provide a hand-supportableimaging-based bar code reading system that employs a novel method ofillumination, which automatically reduces noise in detected digitalimages caused by specular reflection during illumination and imagingoperations.

Another object of the present invention is to provide a novel method ofand system for producing a composite DOF plot that completelytheoretically characterizes the Depth of Field (DOF) of the imageformation optics employed in an imaging-based bar code symbol reader.

Another object of the present invention is to provide a hand-supportabledigital imaging-based bar code symbol reader supporting narrow-area andwide-area modes of illumination and image capture.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader having a multi-mode bar code symbolimage processor dynamically reconfigurable in response to real-timeimage processing operations carried out on captured images.

Another object of the present invention is to provide a hand-supportablesemi-automatic imaging-based bar code reading system wherein anLED-based illumination subsystem automatically illuminates a targetobject in a narrow-area field of illumination while a multi-mode imageformation and detection (IFD) subsystem captures a narrow-area image ofan aligned 1 D bar code symbol therein, and when manually switched intoa wide-area illumination and image capture mode by a trigger switch, theLED-based illumination subsystem illuminates the target object in awide-area field of illumination, while the multi-mode IFD subsystemcaptures a wide-area image of randomly-oriented 1 D or 2 D code symbolsthereon.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing a multi-mode illuminationsubsystem enabling narrow-area illumination for aiming at a targetobject and illuminating aligned 1 D bar code symbols during thenarrow-area image capture mode, and wide-area illumination forilluminating randomly-oriented 1 D and 2 D bar code symbols during thewide-area image capture mode.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing automatic object presenceand range detection to control the generation of near-field andfar-field wide-area illumination during bar code symbol imagingoperations.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing a CMOS-type image sensorusing global exposure techniques.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing a CMOS-type image sensingarray with a band-pass optical filter subsystem integrated within thehand-supportable housing thereof.

Another object of the present invention is to provide a hand-supportableimaging-based auto-discriminating 1 D/2 D bar code symbol readeremploying a multi-mode image processing bar code symbol readingsubsystem having a plurality of modes of operation which are dynamicallyreconfigurable in response to real-time image analysis.

Another object of the present invention is to provide a hand-supportablemulti-mode imaging-based bar code symbol reader employing an automaticillumination and exposure control subsystem that automatically controlsthe operation of an LED-based multi-mode illumination subsystem so thatdetected objects are sufficiently illuminated and good quality digitalimages of detected objects are formed and detected by a multi-mode imageformation and detection subsystem during illumination and imagingoperations.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing a tri-mode LED-basedillumination subsystem.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing a multi-modeimage-processing based bar code reading subsystem with modularimage-processing architecture.

Another object of the present invention is to provide a method ofperforming auto-discrimination of 1 D/2 D bar code symbologies in asemi-automatic hand-supportable imaging-based bar code symbol readerhaving narrow-area and wide-area image capture modes of operation.

Another object of the present invention is to provide a method of andapparatus for processing captured digital images of objects within asemi-automatic hand-supportable imaging-based bar code symbol reader soas to read 1 D and/or 2 D bar code symbols graphically representedtherein.

Another object of the present invention is to provide a hand-supportableimage-based bar code symbol reader employing helically-sweepingfeature-extraction analysis on a captured digital image of an objectreferenced from the center thereof.

Another object of the present invention is to provide an automatichand-supportable image-based bar code symbol reader having animage-processing based bar code reading subsystem employing simpledecode image processing operations applied in an outwardly-directedmanner referenced from the center of a captured narrow-area digitalimage of an object bearing a 1 D bar code symbol.

Another object of the present invention is to provide a digitalimaging-based bar code symbol reading system employing an LED-basedmulti-mode illumination subsystem with far-field and near-field LEDillumination arrays driven by an automatic light exposure measurementand illumination control subsystem responsive to control activationsignals generated by an automatic object presence and range detectionsubsystem.

Another object of the present invention is to provide a digitalimaging-based bar code symbol reader employing an LED-based illuminationsubsystem driven by an automatic light exposure measurement and controlsubsystem responsive to control activation signals generated by anarea-type image sensing array and an automatic object presence detectionsubsystem during object illumination and image capture operations.

Another object of the present invention is to provide a hand-supportableimaging-based bar code symbol reader employing an automatic lightexposure measurement and illumination control subsystem which controlsLED illumination driver circuitry to expose an automatically detectedobject to a field of narrow-band LED-based illumination only whensubstantially all of the rows of pixels in a CMOS image sensing arrayare in a state of integration, thereby capturing high quality digitalimages independent of the relative motion between said bar code symbolreader and the object.

Another object of the present invention is to provide a digitalimaging-based bar code reading system wherein the time duration that aCMOS image sensing array is exposed to narrow-band illumination from anLED-based illumination array is managed by controlling the time thatsaid LED-based illumination array generates narrow-band illumination inresponse to control activation signals generated by the CMOS imagesensing array and an automatic object presence detection subsystemaboard said system.

Another object of the present invention is to provide a hand-supportabledigital imaging-based bar code symbol reading system having a subsystemfor automatically processing a captured digital image along a set ofparallel virtual scan lines spaced-apart by a number of pixel-offsetdistances proportional to the maximum pixel height of the region ofinterest (ROI) in the captured digital image containing a bar codesymbol.

Another object of the present invention is to provide a digitalimaging-based bar code symbol reading system employing a multi-modeimage-processing symbol reading subsystem that switches its modes ofreading during a single bar code symbol reading cycle, and within eachsaid mode of reading, automatically applies a different image-processingbased bar code symbol reading methodology.

Another object of the present invention is to provide a method of andsystem for determining the lower limit of decoding resolution in animaging-based bar code symbol reader.

Another object of the present invention is to provide a hand-supportabledigital imaging-based bar code symbol reading system employing a methodof intelligently illuminating an object so as to generate a digitalimage thereof which is substantially free of noise caused byspecular-type reflection of illumination off said object duringillumination and imaging operations.

Another object of the present invention is to provide a hand-supportablesemi-automatic digital imaging-based bar code symbol reading systemrealized upon a multi-tier modular software platform.

Another object of the present invention is to provide a digitalimaging-based bar code symbol driven portable data terminal system.

Another object of the present invention is to provide a hand-supportabledigital imaging-based bar code reading system wherein, during eachimaging cycle, a single frame of pixel data is automatically detected bya CMOS area-type image sensing array when substantially all of the rowsof pixels therein are in a state of integration and have a commonintegration time, and then pixel data is transmitted from said CMOSarea-type image sensing array into a FIFO buffer, and then mapped intomemory for subsequent image processing.

Another object of the present invention is to provide a method ofautomatic illumination control within a hand-supportable imager havingan image sensing array with a field of view, and a LED-basedillumination subsystem, wherein the method employs a software-basedimage illumination metering program that involves analyzing the spatialintensity of a captured image.

Another object of the present invention is to provide a hand-supportabledigital imaging-based bar code symbol reading device comprising anautomatic light exposure measurement and illumination control subsystemand a software-based illumination metering program, for improvedillumination control.

Another object of the present invention is to provide a hand-supportabledigital image-processing based bar code symbol reading system employingan image cropping zone (ICZ) framing and post-image capture croppingprocess.

These and other objects of the present invention will become moreapparently understood hereinafter and in the Claims to Inventionappended hereto.

BRIEF DESCRIPTION OF THE DRAWINGS OF PRESENT INVENTION

For a more complete understanding of how to practice the Objects of thePresent Invention, the following Detailed Description of theIllustrative Embodiments can be read in conjunction with theaccompanying Drawings, briefly described below.

FIG. 1A is a rear perspective view of the hand-supportable digitalimaging-based bar code symbol reading device of the first illustrativeembodiment of the present invention;

FIG. 1B is a front perspective view of the hand-supportable digitalimaging-based bar code symbol reading device of the first illustrativeembodiment of the present invention;

FIG. 1C is an elevated left side view of the hand-supportable digitalimaging-based bar code symbol reading device of the first illustrativeembodiment of the present invention;

FIG. 1D is an elevated right side view of the hand-supportable digitalimaging-based bar code symbol reading device of the first illustrativeembodiment of the present invention;

FIG. 1E is an elevated rear view of the hand-supportable digitalimaging-based bar code symbol reading device of the first illustrativeembodiment of the present invention;

FIG. 1F is an elevated front view of the hand-supportable digitalimaging-based bar code symbol reading device of the first illustrativeembodiment of the present invention, showing components associated withits illumination subsystem and its image capturing subsystem;

FIG. 1G is a bottom view of the hand-supportable digital imaging-basedbar code symbol reading device of the first illustrative embodiment ofthe present invention;

FIG. 1H is a top rear view of the hand-supportable digital imaging-basedbar code symbol reading device of the first illustrative embodiment ofthe present invention;

FIG. 1I is a first perspective exploded view of the hand-supportabledigital imaging-based bar code symbol reading device of the firstillustrative embodiment of the present invention;

FIG. 1J is a second perspective exploded view of the hand-supportabledigital imaging-based bar code symbol reading device of the firstillustrative embodiment of the present invention;

FIG. 1K is a third perspective exploded view of the hand-supportabledigital imaging-based bar code symbol reading device of the firstillustrative embodiment of the present invention;

FIG. 2A1 is a schematic block diagram representative of a system designfor the hand-supportable digital imaging-based bar code symbol readingdevice illustrated in FIGS. 1A through 1L, wherein the system design isshown comprising (1) a Multi-Mode Area-Type Image Formation andDetection (i.e. Camera) Subsystem having image formation (camera) opticsfor producing a field of view (FOV) upon an object to be imaged and aCMOS or like area-type image sensing array for detecting imaged lightreflected off the object during illumination operations in either (i) anarrow-area image capture mode in which a few central rows of pixels onthe image sensing array are enabled, or (ii) a wide-area image capturemode in which all rows of the image sensing array are enabled, (2) aMulti-Mode LED-Based Illumination Subsystem for producing narrow andwide area fields of narrow-band illumination within the FOV of the ImageFormation And Detection Subsystem during narrow and wide area modes ofimage capture, respectively, so that only light transmitted from theMulti-Mode Illumination Subsystem and reflected from the illuminatedobject and transmitted through a narrow-band transmission-type opticalfilter realized within the hand-supportable housing (i.e. using ared-wavelength high-pass reflecting window filter element disposed atthe light transmission aperture thereof and a low-pass filter before theimage sensor) is detected by the image sensor and all other componentsof ambient light are substantially rejected, (3) an IR-based objectpresence and range detection subsystem for producing an IR-based objectdetection field within the FOV of the Image Formation and DetectionSubsystem, (4) an Automatic Light Exposure Measurement and IlluminationControl Subsystem for controlling the operation of the LED-BasedMulti-Mode Illumination Subsystem, (5) an Image Capturing and BufferingSubsystem for capturing and buffering 2-D images detected by the ImageFormation and Detection Subsystem, (6) a Multimode Image-ProcessingBased Bar Code Symbol Reading Subsystem for processing images capturedand buffered by the Image Capturing and Buffering Subsystem and reading1 D and 2 D bar code symbols represented, and (7) an Input/OutputSubsystem for outputting processed image data and the like to anexternal host system or other information receiving or respondingdevice, in which each said subsystem component is integrated about (8) aSystem Control Subsystem, as shown;

FIG. 2A2 is a schematic block representation of the multi-ModeImage-Processing Based Bar Code Symbol Reading Subsystem, realized usingthe three-tier computing platform illustrated in FIG. 2B;

FIG. 2B is a schematic diagram representative of a system implementationfor the hand-supportable digital imaging-based bar code symbol readingdevice illustrated in FIGS. 1A through 2A2, wherein the systemimplementation is shown comprising (1) an illumination board 33 carryingcomponents realizing electronic functions performed by the Multi-ModeLED-Based Illumination Subsystem and the Automatic Light ExposureMeasurement and Illumination Control Subsystem, (2) a CMOS camera boardcarrying a high resolution (1280×1024 8-bit 6 micron pixel size) CMOSimage sensor array running at 25 Mhz master clock, at 7 frames/second at1280*1024 resolution with randomly accessible region of interest (ROI)window capabilities, realizing electronic functions performed by themulti-mode area-type Image Formation and Detection Subsystem, (3) a CPUboard (i.e. computing platform) including (i) an Intel Sabinal 32-BitMicroprocessor PXA210 running at 200 Mhz 1.0 core voltage with a 16 bit100 Mhz external bus speed, (ii) an expandable (e.g. 8+ megabyte) IntelJ3 Asynchronous 16-bit Flash memory, (iii) a 16 Megabytes of 100 MHzSDRAM, (iv) an Xilinx Spartan II FPGA FIFO 39 running at 50 Mhz clockfrequency and 60 MB/Sec data rate, configured to control the cameratimings and drive and image acquisition process, (v) a multimedia cardsocket, for realizing the other subsystems of the system, (vi) a powermanagement module for the MCU adjustable by the system bus, and (vii) apair of UARTs (one for an IRDA port and one for a JTAG port), (4) aninterface board for realizing the functions performed by the I/Osubsystem, and (5) an IR-based object presence and range detectioncircuit for realizing the IR-based Object Presence and Range DetectionSubsystem;

FIG. 3A is a schematic representation showing the spatial relationshipsbetween the near and far and narrow and wide area fields of narrow-bandillumination within the FOV of the Multi-Mode Image Formation andDetection Subsystem during narrow and wide area image capture modes ofoperation;

FIG. 3B is a perspective partially cut-away view of the hand-supportabledigital imaging-based bar code symbol reading device of the firstillustrative embodiment, showing the LED-Based Multi-Mode IlluminationSubsystem transmitting visible narrow-band illumination through itsnarrow-band transmission-type optical filter system and illuminating anobject with such narrow-band illumination, and also showing the imageformation optics, including the low pass filter before the image sensingarray, for collecting and focusing light rays reflected from theilluminated object, so that an image of the object is formed anddetected using only the optical components of light contained within thenarrow-band of illumination, while all other components of ambient lightare substantially rejected before image detection at the image sensingarray;

FIG. 3C is a schematic representation showing the geometrical layout ofthe optical components used within the hand-supportable digitalimaging-based bar code symbol reading device of the first illustrativeembodiment, wherein the red-wavelength reflecting high-pass lens elementis positioned at the imaging window of the device before the imageformation lens elements, while the low-pass filter is disposed beforethe image sensor between the image formation elements, so as to imagethe object at the image sensing array using only optical componentswithin the narrow-band of illumination, while rejecting all othercomponents of ambient light;

FIG. 3D is a schematic representation of the image formation opticalsubsystem employed within the hand-supportable digital imaging-based barcode symbol reading device of the first illustrative embodiment, whereinall three lenses are made as small as possible (with a maximum diameterof 12 mm), all have spherical surfaces, all are made from common glass,e.g. LAK2 (˜LaK9), ZF10 (=SF8), LAF2 (˜LaF3);

FIG. 3E is a schematic representation of the lens holding assemblyemployed in the image formation optical subsystem of thehand-supportable digital imaging-based bar code symbol reading device ofthe first illustrative embodiment, showing a two-piece barrel structurewhich holds the lens elements, and a base structure which holds theimage sensing array, wherein the assembly is configured so that thebarrel structure slides within the base structure so as to focus theassembly;

FIG. 3F1 is a first schematic representation showing, from a side view,the physical position of the LEDs used in the Multi-Mode IlluminationSubsystem, in relation to the image formation lens assembly, the imagesensing array employed therein (e.g. a Motorola MCM20027 or NationalSemiconductor LM9638 CMOS 2-D image sensing array having a 1280×1024pixel resolution (½″ format), 6 micron pixel size, 13.5 Mhz clock rate,with randomly accessible region of interest (ROI) window capabilities);

FIG. 3F2 is a second schematic representation showing, from an axialview, the physical layout of the LEDs used in the Multi-ModeIllumination Subsystem of the digital imaging-based bar code symbolreading device, shown in relation to the image formation lens assembly,and the image sensing array employed therein;

FIG. 3G is a flow chart describing the steps involved in determining theDepth of Field (DOF) of the image formation optics assembly employed inthe bar code reading system of the present invention;

FIG. 4A is a schematic representation of the Depth of Field Chart usedin the design of the image formation optics in the digital

imaging-based bar code symbol reading device, wherein image formationlens resolution characteristics are plotted against the pixel limits ofthe image sensing array;

FIG. 4B is a graphical chart illustrating the performance of the imageformation optics of the digital imaging-based bar code symbol readingdevice of the present invention, plotting object distance (centimeters)against MTF values of image formation optics;

FIG. 4C is a schematic representation illustrating the Depth of Field ofthe image formation optics of the digital imaging-based bar code symbolreading device of the present invention, measured in millimeters, andshowing the narrowest bar code element dimension that can be measuredover particular regions within its Depth of Field;

FIG. 4D shows a DOF chart that plots the resolution of the imageformation optics, indicating only the optical performance of thesubsystem;

FIG. 4E graphically illustrates how to read off the DOF for a certainmil size code, considering only the optical performance of the imageformation optics of the Image Formation and Detection Subsystem;

FIG. 4F shows the 1.4 and 1.6 pixel sampling limits plotted on the sameaxes as the optical performance curve for a fixed focal length reader(as they are functions of object distance);

FIG. 4G graphically illustrates how to determine the composite DOF curveof the Image Formation and Detection Subsystem, considering opticalperformance and sampling limit together, for the 1.6 pixel case;

FIG. 4H graphically illustrates how to read off the DOF for a certainmil size code, considering optical performance and sampling limittogether, for the 1.6 pixel case;

FIG. 4I1 through 4I3, taken together, show an exemplary computer programwritten in ZPL (Zemax Programming Language) and capable of generatingthe composite DOF chart;

FIG. 5A1 is a schematic representation specifying the range ofnarrow-area illumination, near-field wide-area illumination, andfar-field wide-area illumination produced from the LED-Based Multi-ModeIllumination Subsystem employed in the hand-supportable digitalimaging-based bar code symbol reading device of the present invention;

FIG. 5A2 is a table specifying the geometrical properties andcharacteristics of each illumination mode supported by the LED-BasedMulti-Mode Illumination Subsystem employed in the hand-supportabledigital imaging-based bar code symbol reading device of the presentinvention;

FIG. 5B is a schematic representation illustrating the physicalarrangement of LED light sources associated with the narrow-areaillumination array and the near-field and far-field wide-areaillumination arrays employed in the digital imaging-based bar codesymbol reading device of the present invention, wherein the LEDs in thefar-field wide-area illumination arrays are located behind sphericallenses, the LEDs in the narrow-area illumination array are disposedbehind cylindrical lenses, and the LEDs in the near-field wide-areaillumination array are unlensed in the first illustrative embodiment ofthe Digital Imaging-Based Bar Code Reading Device;

FIG. 5C1 is a graphical representation showing the Lambertian emittanceversus wavelength characteristics of the LEDs used to implement thenarrow-area illumination array in the Multi-Mode Illumination Subsystemof the present invention;

FIG. 5C2 is a graphical representation showing the Lambertian emittanceversus polar angle characteristics of the LEDs used to implement thenarrow-area illumination array in the Multi-Mode Illumination Subsystemof the present invention;

FIG. 5C3 is a schematic representation of the cylindrical lenses usedbefore the LEDs in the narrow-area (linear) illumination arrays in thedigital imaging-based bar code symbol reading device of the presentinvention, wherein the first surface of the cylindrical lens is curvedvertically to create a narrow-area (i.e. linear) illumination pattern,and the second surface of the cylindrical lens is curved horizontally tocontrol the height of the of the narrow-area illumination pattern toproduce a narrow-area (i.e. linear) illumination field;

FIG. 5C4 is a schematic representation of the layout of the pairs ofLEDs and two cylindrical lenses used to implement the narrow-area(linear) illumination array employed in the digital imaging-based barcode symbol reading device of the present invention;

FIG. 5C5 is a set of six cross-sectional illumination profiles for thenarrow-area (linear) illumination fields produced by the narrow-area(linear) illumination array employed in the digital imaging-based barcode symbol reading device of the illustrative embodiment, taken at 30,40, 50, 80, 120, and 220 millimeters along the field away from theimaging window (i.e. working distance) of the digital imaging-based barcode symbol reading device where at about 80 millimeters from theimaging window, the narrow-area illumination field attains asubstantially rectangular cross-sectional profile while its spatialintensity becomes substantially uniform across its cross-sectionalprofile;

FIG. 5D1 is a graphical representation showing the Lambertian emittanceversus wavelength characteristics of the LEDs used to implement the widearea illumination arrays employed in the digital imaging-based bar codesymbol reading device of the present invention;

FIG. 5D2 is a graphical representation showing the Lambertian emittanceversus polar angle characteristics of the LEDs used to implement thefar-field and near-field wide-area illumination arrays employed in thedigital imaging-based bar code symbol reading device of the presentinvention;

FIG. 5D3 is a schematic representation of the plano-convex lenses usedbefore the LEDs in the far-field wide-area illumination arrays in theillumination subsystem of the present invention,

FIG. 5D4 is a schematic representation of the layout of LEDs andplano-convex lenses used to implement the far and narrow wide-areaillumination array employed in the digital imaging-based bar code symbolreading device of the present invention, wherein the illumination beamproduced therefrom is aimed by positioning the lenses at angles beforethe LEDs in the near-field (and far-field) wide-area illumination arraysemployed therein;

FIG. 5D5 is a set of six cross-sectional illumination profiles for thenear-field wide-area illumination fields produced by the near-fieldwide-area illumination arrays employed in the digital imaging-based barcode symbol reading device of the illustrative embodiment, taken at 10,20, 30, 40, 60, and 100 millimeters along the field away from theimaging window (i.e. working distance) of the digital imaging-based barcode symbol reading device, where at about 40 millimeters from theimaging window, the spatial intensity of the near-field wide-areaillumination field is substantially uniform while its oval-likecross-sectional profile begins to converge toward a substantiallycircular cross-sectional profile attained at 100 mm;

FIG. 5D6 is a set of three illumination profiles for the far-fieldwide-area illumination fields produced by the far-field wide-areaillumination arrays employed in the digital imaging-based bar codesymbol reading device of the illustrative embodiment, taken at 100, 150and 220 millimeters along the field away from the imaging window (i.e.working distance) of the digital imaging-based bar code symbol readingdevice, wherein at about 100 millimeters from the imaging window, thefar-field wide-area illumination field attains a substantially uniformspatial intensity across its substantially circular cross-sectionalprofile;

FIG. 5D7 is a table illustrating a preferred method of calculating thepixel intensity value for the center of the far-field wide-areaillumination field produced from the Multi-Mode Illumination Subsystememployed in the digital imaging-based bar code symbol reading device ofthe present invention, showing a significant signal strength (greaterthan 80 DN);

FIG. 6A1 is a schematic representation showing the red-wavelengthreflecting (high-pass) imaging window integrated within thehand-supportable housing of the digital imaging-based bar code symbolreading device, and the low-pass optical filter disposed before its CMOSimage sensing array therewithin, cooperate to form a narrow-band opticalfilter subsystem for transmitting substantially only the very narrowband of wavelengths (e.g. 620-700 nanometers) of visible illuminationproduced from the Multi-Mode Illumination Subsystem employed in thedigital imaging-based bar code symbol reading device, and rejecting allother optical wavelengths outside this narrow optical band howevergenerated (i.e. ambient light sources);

FIG. 6A2 is a schematic representation of transmission characteristics(energy versus wavelength) associated with the low-pass optical filterelement disposed after the red-wavelength reflecting high-pass imagingwindow within the hand-supportable housing of the digital imaging-basedbar code symbol reading device, but before its CMOS image sensing array,showing that optical wavelengths below 620 nanometers are transmittedand wavelengths above 620 nm are substantially blocked (e.g. absorbed orreflected);

FIG. 6A3 is a schematic representation of transmission characteristics(energy versus wavelength) associated with the red-wavelength reflectinghigh-pass imaging window integrated within the hand-supportable housingof the digital imaging-based bar code symbol reading device of thepresent invention, showing that optical wavelengths above 700 nanometersare transmitted and wavelengths below 700 nm are substantially blocked(e.g. absorbed or reflected);

FIG. 6A4 is a schematic representation of the transmissioncharacteristics of the narrow-based spectral filter subsystem integratedwithin the hand-supportable imaging-based bar code symbol reading deviceof the present invention, plotted against the spectral characteristicsof the LED-emissions produced from the Multi-Mode Illumination Subsystemof the illustrative embodiment of the present invention;

FIG. 7A is a schematic representation showing the geometrical layout ofthe spherical/parabolic light reflecting/collecting mirror andphotodiode associated with the Automatic Light Exposure Measurement andIllumination Control Subsystem, and arranged within the hand-supportabledigital imaging-based bar code symbol reading device of the illustrativeembodiment, wherein incident illumination is collected from a selectedportion of the center of the FOV of the system using a spherical lightcollecting mirror, and then focused upon a photodiode for detection ofthe intensity of reflected illumination and subsequent processing by theAutomatic Light Exposure Measurement and Illumination Control Subsystem,so as to then control the illumination produced by the LED-basedMulti-Mode Illumination Subsystem employed in the digital imaging-basedbar code symbol reading device of the present invention;

FIG. 7B is a schematic diagram of the Automatic Light ExposureMeasurement and Illumination Control Subsystem employed in thehand-supportable digital imaging-based bar code symbol reading device ofthe present invention, wherein illumination is collected from the centerof the FOV of the system and automatically detected so as to generate acontrol signal for driving, at the proper intensity, the narrow-areaillumination array as well as the far-field and narrow-field wide-areaillumination arrays of the Multi-Mode Illumination Subsystem, so thatthe CMOS image sensing array produces digital images of illuminatedobjects of sufficient brightness;

FIGS. 7C1 and 7C2, taken together, set forth a schematic diagram of ahybrid analog/digital circuit designed to implement the Automatic LightExposure Measurement and Illumination Control Subsystem of FIG. 7Bemployed in the hand-supportable digital imaging-based bar code symbolreading device of the present invention;

FIG. 7D is a schematic diagram showing that, in accordance with theprinciples of the present invention, the CMOS image sensing arrayemployed in the digital imaging-based bar code symbol reading device ofthe illustrative embodiment, once activated by the System ControlSubsystem (or directly by the trigger switch), and when all of the rowsin the image sensing array are in a state of integration operation,automatically activates the Automatic Light Exposure Measurement andIllumination Control Subsystem which, in response thereto, automaticallyactivates the LED illumination driver circuitry to automatically drivethe appropriate LED illumination arrays associated with the Multi-ModeIllumination Subsystem in a precise manner and globally expose theentire CMOS image detection array with narrowly tuned LED-basedillumination when all of its rows of pixels are in a state ofintegration, and thus have a common integration time, thereby capturinghigh quality images independent of the relative motion between the barcode reader and the object;

FIGS. 7E1 and 7E2, taken together, set forth a flow chart describing thesteps involved in carrying out the global exposure control method of thepresent invention, within the digital imaging-based bar code symbolreading device of the illustrative embodiment;

FIG. 8 is a schematic block diagram of the IR-based automatic ObjectPresence and Range Detection Subsystem employed in the hand-supportabledigital imaging-based bar code symbol reading device of the presentinvention, wherein a first range indication control signal is generatedupon detection of an object within the near-field region of theMulti-Mode Illumination Subsystem, and wherein a second range indicationcontrol signal is generated upon detection of an object within thefar-field region of the Multi-Mode Illumination Subsystem;

FIG. 9 is a schematic representation of the hand-supportable digitalimaging-based bar code symbol reading device of the present invention,showing that its CMOS image sensing array is operably connected to itsmicroprocessor through a FIFO (realized by way of a FPGA) and a systembus, and that its SDRAM is also operably connected to the microprocessorby way of the system bus, enabling the mapping of pixel data captured bythe imaging array into the SDRAM under the control of the direct memoryaccess (DMA) module within the microprocessor;

FIG. 10 is a schematic representation showing how the bytes of pixeldata captured by the CMOS imaging array within the hand-supportabledigital imaging-based bar code symbol reading device of the presentinvention, are mapped into the addressable memory storage locations ofits SDRAM during each image capture cycle carried out within the device;

FIG. 11 is a schematic representation showing the software modulesassociated with the three-tier software architecture of thehand-supportable digital imaging-based bar code symbol reading device ofthe present invention, namely: the Main Task module, the CodeGate Taskmodule, the Narrow-Area Illumination Task module, the Metroset Taskmodule, the Application Events Manager module, the User Commands Tablemodule, and the Command Handler module residing with the Applicationlayer of the software architecture; the Tasks Manager module, the EventsDispatcher module, the Input/Output Manager module, the User CommandsManager module, the Timer Subsystem module, the Input/Output Subsystemmodule and the Memory Control Subsystem module residing with the SystemCore (SCORE) layer of the software architecture; and the Linux Kernalmodule, the Linux File System module, and Device Drivers modulesresiding within the Linux Operating System (OS) layer of the softwarearchitecture;

FIG. 12A is a schematic representation of the Events Dispatcher softwaremodule which provides a means of signaling and delivering events to theApplication Events Manager, including the starting of a new task,stopping a currently running task, doing something, or doing nothing andignoring the event;

FIG. 12B is a table listing examples of system-defined events which canoccur and be dispatched within the hand-supportable digitalimaging-based bar code symbol reading device of the present invention,namely: SCORE_EVENT_POWER_UP which signals the completion of systemstart-up and involves no parameters;_SCORE_EVENT_TIMEOUT which signalsthe timeout of the logical timer, and involves the parameter “pointer totimer id”; SCORE_EVENT_UNEXPECTED_INPUT which signals that theunexpected input data is available and involves the parameter “pointerto connection id”; SCORE_EVENT_TRIG_ON which signals that the userpulled the trigger switch and involves no parameters;SCORE_EVENT_TRIG_OFF which signals that the user released the triggerswitch and involves no parameters; SCORE_EVENT_OBJECT_DETECT_ON whichsignals that the object is positioned under the bar code reader andinvolves no parameters; SCORE_EVENT_OBJECT_DETECT_OFF which signals thatthe object is removed from the field of view of the bar code reader andinvolves no parameters; SCORE_EVENT_EXIT_TASK which signals the end ofthe task execution and involves the pointer UTID; andSCORE_EVENT_ABORT_TASK which signals the aborting of a task duringexecution;

FIG. 12C is a schematic representation of the Tasks Manager softwaremodule which provides a means for executing and stopping applicationspecific tasks (i.e. threads);

FIG. 12D is a schematic representation of the Input/Output Managersoftware module (i.e. Input/Output Subsystem), which runs in thebackground and monitors activities of external devices and userconnections, and signals appropriate events to the Application Layer,when such activities are detected;

FIGS. 12E1 and 12E2 set forth a schematic representation of theInput/Output Subsystem software module which provides a means forcreating and deleting input/output connections, and communicating withexternal systems and devices;

FIGS. 12F1 and 12F2 set forth a schematic representation of the TimerSubsystem which provides a means for creating, deleting, and utilizinglogical timers;

FIGS. 12G1 and 12G2 set forth a schematic representation of the MemoryControl Subsystem which provides an interface for managing thethread-level dynamic memory with the device, is fully compatible withstandard dynamic memory management functions, as well as a means forbuffering collected data;

FIG. 12H is a schematic representation of the user commands managerwhich provides a standard way of entering user commands, and executingapplication modules responsible for handling the same;

FIG. 12I is a schematic representation of the device driver softwaremodules, which includes trigger switch drivers for establishing asoftware connection with the hardware-based manually-actuated triggerswitch employed on the digital imaging-based bar code symbol readingdevice, an image acquisition driver for implementing image acquisitionfunctionality aboard the digital imaging-based bar code symbol readingdevice, and an IR driver for implementing object detection functionalityaboard the imaging-based bar code symbol reading device;

FIG. 13A is an exemplary flow chart representation showing how when theuser points the bar code reader towards a bar code symbol, the IR devicedrivers detect that object within the field, and then wakes up theInput/Output Manager software module at the System Core Layer;

FIG. 13B is an exemplary flow chart representation showing how upondetecting an object, the Input/Output Manager posts theSCORE_OBJECT_DETECT_ON event to the Events Dispatcher software module;

FIG. 13C is an exemplary flow chart representation showing how, inresponse to detecting an object, the Events Dispatcher software modulepasses the SCORE_OBJECT_DETECT_ON event to the Application Layer;

FIG. 13D is an exemplary flow chart representation showing how uponreceiving the SCORE_OBJECT_DETECT_ON event at the Application Layer, theApplication Events Manager executes an event handling routine whichactivates the narrow-area illumination array associated with theMulti-Mode Illumination Subsystem, and executes either the CodeGate Taskdescribed in FIG. 13E (when required by System Mode in which the Deviceis programmed) or the Narrow-Area Illumination Task described in FIG.13M (when required by System Mode in which the Device is programmed);

FIG. 13E is an exemplary flow chart representation showing whatoperations are carried out when the CodeGate Task is (enabled and)executed within the Application Layer;

FIG. 13F is an exemplary flow chart representation showing how, when theuser pulls the trigger switch on the bar code reader while the Code Taskis executing, the trigger device driver wakes up the Input/OutputManager at the System Core Layer;

FIG. 13G is an exemplary flow chart representation showing how, inresponse to waking up, the Input/Output Manager posts theSCORE_TRIGGER_ON event to the Events Dispatcher;

FIG. 13H is an exemplary flow chart representation showing how theEvents Dispatcher passes on the SCORE_TRIGGER_ON event to theApplication Events Manager at the Application Layer;

FIGS. 13I1 and 13I2, taken together, set forth an exemplary flow chartrepresentation showing how the Application Events Manager responds tothe SCORE_TRIGGER_ON event by invoking a handling routine within theTask Manager at the System Core Layer which deactivates the narrow-areaillumination array associated with the Multi-Mode IlluminationSubsystem, cancels the CodeGate Task or the Narrow-Area IlluminationTask (depending on which System Mode the Device is programmed), andexecutes the Main Task;

FIG. 13J is an exemplary flow chart representation showing whatoperations are carried out when the Main Task is (enabled and) executedwithin the Application Layer;

FIG. 13K is an exemplary flow chart representation showing whatoperations are carried out when the Data Output Procedure, called in theMain Task, is executed within the Input/Output Subsystem software modulein the Application Layer;

FIG. 13L is an exemplary flow chart representation showing decodedsymbol character data being sent from the Input/Output Subsystem to theDevice Drivers within the Linux OS Layer of the system;

FIG. 13M is an exemplary flow chart representation showing whatoperations are carried out when the Narrow-Area Illumination Task is(enabled and) executed within the Application Layer;

FIGS. 13N1 through 13N3, taken together, set forth a flow chartdescribing a novel method of generating wide-area illumination, for useduring the Main Task routine so as to illuminate objects with awide-area illumination field in a manner which substantially reducesspecular-type reflection at the CMOS image sensing array in the digitalimaging-based bar code reading device of the present invention;

FIG. 14 is a table listing various bar code symbologies supported by theMulti-Mode Bar Code Symbol Reading Subsystem module employed within thehand-supportable digital imaging-based bar code reading device of thepresent invention;

FIG. 15 is a table listing the four primary modes in which theMulti-Mode Bar Code Symbol Reading Subsystem module can be programmed tooperate, namely: the Automatic Mode wherein the Multi-Mode Bar CodeSymbol Reading Subsystem is configured to automatically process acaptured frame of digital image data so as to search for one or more barcodes represented therein in an incremental manner, and to continuesearching until the entire image is processed; the Manual Mode whereinthe Multi-Mode Bar Code Symbol Reading Subsystem is configured toautomatically process a captured frame of digital image data, startingfrom the center or sweep spot of the image at which the user would haveaimed the bar code reader, so as to search for (i.e. find) one or morebar code symbols represented therein, by searching in a helical mannerthrough frames or blocks of extracted image feature data and marking thesame and processing the corresponding raw digital image data until a barcode symbol is recognized/read within the captured frame of image data;the ROI-Specific Mode wherein the Multi-Mode Bar Code Symbol ReadingSubsystem is configured to automatically process a specified “region ofinterest” (ROI) in a captured frame of digital image data so as tosearch for one or more bar codes represented therein, in response tocoordinate data specifying the location of the bar code within the fieldof view of the multi-mode image formation and detection system; theNoFinder Mode wherein the Multi-Mode Bar Code Symbol Reading Subsystemis configured to automatically process a captured narrow-area (linear)frame of digital image data, without feature extraction and markingoperations used in the Automatic and Manual Modes, so as to read one ormore bar code symbols represented therein; and the Omniscan Mode,wherein the Multi-Mode Bar Code Symbol Reading Subsystem is configuredto automatically process a captured frame of digital image data alongany one or more predetermined virtual scan line orientations, withoutfeature extraction and marking operations used in the Automatic andManual Modes, so as to read one or more bar code symbols representedtherein;

FIG. 16 an exemplary flow chart representation showing the stepsinvolved in setting up and cleaning up the software sub-Applicationentitled “Multi-Mode Image-Processing Based Bar Code Symbol ReadingSubsystem”, once called from either (i) the CodeGate Task softwaremodule at the Block entitled READ BAR CODE(S) IN CAPTURED NARROW-AREAIMAGE indicated in FIG. 13E, or (ii) the Main Task software module atthe Block entitled “READ BAR CODE(S) IN CAPTURED WIDE-AREA IMAGE”indicated in FIG. 13J;

FIG. 17A is a summary of the steps involved in the decode processcarrying out by the Multi-Mode Bar Code Symbol Reading Subsystem of thepresent invention during its Automatic Mode of operation, wherein (1)the first stage of processing involves searching for (i.e. finding)regions of interest (ROIs) by processing a low resolution image of acaptured frame of high-resolution image data, partitioning thelow-resolution image into N×N blocks, and creating a feature vector foreach block using spatial-derivative based image processing techniques,(2) the second stage of processing involves marking ROIs by examiningthe feature vectors for regions of high-modulation, calculating bar codeorientation and marking the four corners of a bar code as an ROI, and(3) the third stage of processing involves reading any bar code symbolsrepresented within the ROI by traversing the bar code and updating thefeature vectors, examining the zero-crossings of filtered images,creating bar and space patterns, and decoding the bar and space patternsusing conventional decoding algorithms;

FIG. 17B is an exemplary flow chart representation of the steps involvedin the image-processing method carried out by the Multi-Mode Bar CodeSymbol Reading Subsystem during its Automatic Mode of operation;

FIG. 18A is a graphical representation illustrating the generation of alow-resolution image of a package label from an original high-resolutionimage thereof during the first finding stage of processing within theMulti-Mode Bar Code Symbol Reading Subsystem configured in its AutomaticMode of operation;

FIG. 18B is a graphical representation illustrating the partitioning ofthe low-resolution image of the package label, the calculation offeature vectors using the same, and the analysis of these featurevectors for parallel lines, during the first finding stage of processingwithin the Multi-Mode Bar Code Symbol Reading Subsystem during itsAutomatic Mode of operation;

FIG. 18C is a graphical representation showing that the calculation offeature vectors within each block of low-resolution image data, duringthe second marking stage of processing within the Multi-Mode Bar CodeSymbol Reading Subsystem, can involve the use of gradient vectors, edgedensity measures, the number of parallel edge vectors, centroids ofedge1s, intensity variance, and the histogram of intensities capturedfrom the low-resolution image;

FIG. 18D is a graphical representation of the examination of featurevectors looking for high edge density, a large number of parallel edgevectors and large intensity variance, during the second marking stage ofprocessing within the Multi-Mode Bar Code Symbol Reading Subsystemduring its Automatic Mode of operation;

FIGS. 18E and 18F, taken together, set forth graphical representationsof calculating bar code orientation during the second marking stage ofprocessing within the Multi-Mode Bar Code Symbol Reading Subsystemoperating in its Automatic Mode, wherein at each feature vector block,the bar code is traversed (i.e. sliced) at different angles, the slicesare matched with each other based on “least mean square error”, and thecorrect orientation is determined to be that angle which matches themean square error sense through every slice of the bar code symbolrepresented within the captured image;

FIG. 18F is a graphical representation of calculating bar codeorientation, during the second marking stage of processing within theMulti-Mode Bar Code Symbol Reading Subsystem operating in its AutomaticMode;

FIG. 18G is a graphical representation of the marking of the fourcorners of the detected bar code symbol during the second marking stageof processing within the Multi-Mode Bar Code Symbol Reading Subsystemoperating in its Automatic Mode, wherein such marking operations areperformed on the full high-resolution image of the parcel, the bar codeis traversed in either direction starting from the center of the block,the extent of modulation is detected using the intensity variance, andthe x,y coordinates (pixels) of the four corners of the bar code aredetected starting from 1 and 2 and moving perpendicular to the bar codeorientation, and define the ROI by the detected four corners of the barcode symbol within the high-resolution image;

FIG. 18H is a graphical representation of updating the feature vectorsduring the third stage of processing within the Multi-Mode Bar CodeSymbol Reading Subsystem operating in its Automatic Mode, wherein thehistogram component of the feature vector Fv is updated while traversingthe bar code symbol, the estimate of the black-to-white transition iscalculated, and an estimate of narrow and wide elements of the bar codesymbol are calculated;

FIG. 18I is a graphical representation of the search for zero crossingsduring the third stage of processing within the Multi-Mode Bar CodeSymbol Reading Subsystem operating in its Automatic Mode, wherein thehigh-resolution bar code image is median filtered in a directionperpendicular to bar code orientation, the second derivative zerocrossings define edge crossings, the zero-crossing data is used only fordetecting edge transitions, and the black/white transition estimates areused to put upper and lower bounds on the grey levels of the bars andspaces of the bar code symbol represented within the captured image;

FIG. 18J is a graphical representation of creating bar and space patternduring the third stage of processing within the Multi-Mode Bar CodeSymbol Reading Subsystem operating in its Automatic Mode, wherein theedge transition is modeled as a ramp function, the edge transition isassumed to be 1 pixel wide, the edge transition location is determinedat the subpixel level, and the bar and space counts are gathered usingedge transition data;

FIG. 18K is a graphical representation of the decode bar and spacepattern during the third stage of processing within the Multi-Mode BarCode Symbol Reading Subsystem operating in its Automatic Mode, whereinthe bar and space data is framed with borders, and the bar and spacedata is decoded using existing laser scanning bar code decodingalgorithms;

FIG. 19A is a summary of the steps involved in the image-processingmethod carried out by the Multi-Mode Bar Code Symbol Reading Subsystemduring its Manual Mode of operation, wherein (1) the first stage ofprocessing involves searching for (i.e. finding) regions of interest(ROIs) by processing a low resolution image of a captured frame ofhigh-resolution image data, partitioning the low-resolution image intoN×N blocks, and creating a feature vector for the middle block usingspatial-derivative based image processing techniques, (2) the secondstage of processing involves marking ROIs by examining the featurevectors for regions of high-modulation and returning to the first stageto create feature vectors for other blocks surrounding the middle block(in a helical manner), calculating bar code orientation and marking thefour corners of a bar code as an ROI, and (3) the third stage ofprocessing involves reading any bar code symbols represented within theROI by traversing the bar code and updating the feature vectors,examining the zero-crossings of filtered images, creating bar and spacepatterns, and decoding the bar and space patterns using conventionaldecoding algorithms;

FIG. 19B is an exemplary flow chart representation of the steps involvedin the image-processing method carried out by the Multi-Mode Bar CodeSymbol Reading Subsystem during its Manual Mode of operation;

FIG. 20A is a summary of the steps involved in the image processingmethod carried out by the Multi-Mode Bar Code Symbol Reading Subsystemduring its NoFinder Mode of operation, wherein the Decoder Module doesnot employ bar code element finding or marking techniques (i.e. FinderModule and Marker Module) and directly processes a narrow-area portionof a captured high-resolution image, starting from the middle thereof,examines the zero-crossings of the filtered image, creates bar and spacepatterns therefrom, and then decodes the bar and space patterns usingconventional decoding algorithms;

FIG. 20B is an exemplary flow chart representation of the steps involvedin the image-processing method carried out by the Multi-Mode Bar CodeSymbol Reading Subsystem during its NoFinder Mode of operation;

FIG. 21A is a summary of the steps involved in the image-processingmethod carried out by the Multi-Mode Bar Code Symbol Reading Subsystemduring its OmniScan Mode of operation, wherein the Decoder Module doesnot employ bar code element finding or marking techniques (i.e. FinderModule and Marker Module), assumes the imaged bar code symbol resides atthe center of the captured wide-area high-resolution image with about a1:1 aspect ratio, and directly processes the high-resolution image alonga set of parallel spaced-apart (e.g. 50 pixels) virtual scan lines,examines the zero-crossings along the virtual scan lines, creates barand space patterns therefrom, and then decodes the bar and spacepatterns, with the option of reprocessing the high-resolution imagealong a different set of parallel spaced-apart virtual scan linesoriented at a different angle from the previously processed set ofvirtual scan lines (e.g. 0, 30, 60, 90, 120 or 150 degrees);

FIG. 21B is an exemplary flow chart representation of the steps involvedin the image-processing method carried out by the Multi-Mode Bar CodeSymbol Reading Subsystem during its OmniScan Mode of operation;

FIG. 22A is a summary of the steps involved in the image-processingbased bar code reading method carried out by the Multi-Mode Bar CodeSymbol Reading Subsystem of the present invention during its“ROI-Specific” Mode of operation, designed for use in combination withthe Omniscan Mode of operation, wherein (1) the first stage ofprocessing involves receiving the region of interest (ROI) coordinates(x1,x2) obtained during the Omniscan Mode of operation (after theoccurrence of a failure to decode), re-partitioning the capturedlow-resolution image (from the Omniscan Mode) into N×N blocks, andcreating a feature vector for the ROI-specified block(s) usingspatial-derivative based image processing techniques, (2) the secondstage of processing involves marking additional ROIs by examining thefeature vectors for regions of high-modulation and returning to thefirst stage to create feature vectors for other blocks surrounding themiddle block (in a helical manner), calculating bar code orientation andmarking the four corners of a bar code as an ROI, and (3) the thirdstage of processing involves reading any bar code symbols representedwithin the ROI by traversing the bar code symbol and updating thefeature vectors, examining the zero-crossings of filtered images,creating bar and space patterns, and decoding the bar and space patternsusing conventional decoding algorithms;

FIG. 22B is an exemplary flow chart representation of the steps involvedin the image-processing method carried out by the Multi-Mode Bar CodeSymbol Reading Subsystem of the present invention during itsROI-specific Mode of operation;

FIG. 23 is a specification of the Multi-Mode Bar Code Symbol ReadingSubsystem operated during its first multi-read (Omniscan/ROI-Specific)mode of operation;

FIG. 24 is a specification of the Multi-Mode Bar Code Symbol ReadingSubsystem operated during its second multi-read (No-Finder/ROI-Specific)mode of operation;

FIG. 25 is a specification of the Multi-Mode Bar Code Symbol ReadingSubsystem operated during its third multi-read(No-Finder/Omniscan/ROI-Specific) mode of operation; and

FIGS. 26A and 26B provide a table listing the primary Programmable Modesof Bar Code Reading Operation within the hand-supportable DigitalImaging-Based Bar Code Symbol Reading Device of the present invention,namely:

Programmed Mode of System Operation No. 1—Manually-TriggeredSingle-Attempt 1 D Single-Read Mode Employing the No-Finder Mode of theMulti-Mode Bar Code Reading Subsystem;

Programmed Mode Of System Operation No. 2—Manually-TriggeredMultiple-Attempt 1 D Single-Read Mode Employing the No-Finder Mode ofthe Multi-Mode Bar Code Reading Subsystem;

Programmed Mode Of System Operation No. 3—Manually-TriggeredSingle-Attempt 1 D/2 D Single-Read Mode Employing the No-Finder Mode AndThe Automatic Or Manual Modes of the Multi-Mode Bar Code ReadingSubsystem;

Programmed Mode of System Operation No. 4—Manually-TriggeredMultiple-Attempt 1 D/2 D Single-Read Mode Employing the No-Finder ModeAnd The Automatic Or Manual Modes of the Multi-Mode Bar Code ReadingSubsystem;

Programmed Mode of System Operation No. 5—Manually-TriggeredMultiple-Attempt 1 D/2 D Multiple-Read Mode Employing the No-Finder ModeAnd The Automatic Or Manual Modes of the Multi-Mode Bar Code ReadingSubsystem;

Programmed Mode of System Operation No. 6—Automatically-TriggeredSingle-Attempt 1 D Single-Read Mode Employing The No-Finder Mode Of theMulti-Mode Bar Code Reading Subsystem:

Programmed Mode of System Operation No. 7—Automatically-TriggeredMulti-Attempt 1 D Single-Read Mode Employing The No-Finder Mode Of theMulti-Mode Bar Code Reading Subsystem;

Programmed Mode of System Operation No. 8—Automatically-TriggeredMulti-Attempt 1 D/2 D Single-Read Mode Employing The No-Finder Mode andManual and/or Automatic Modes Of the Multi-Mode Bar Code ReadingSubsystem;

Programmed Mode of System Operation No. 9—Automatically-TriggeredMulti-Attempt 1 D/2 D Multiple-Read Mode Employing The No-Finder Modeand Manual and/or Automatic Modes Of the Multi-Mode Bar Code ReadingSubsystem;

Programmable Mode of System Operation No. 10—Automatically-TriggeredMultiple-Attempt 1 D/2 D Single-Read Mode Employing The Manual,Automatic or Omniscan Modes Of the Multi-Mode Bar Code ReadingSubsystem;

Programmed Mode of System Operation No. 11—Semi-Automatic-TriggeredSingle-Attempt 1 D/2 D Single-Read Mode Employing The No-Finder Mode AndThe Automatic Or Manual Modes Of the Multi-Mode Bar Code ReadingSubsystem;

Programmable Mode of System Operation No. 12—Semi-Automatic-TriggeredMultiple-Attempt 1 D/2 D Single-Read Mode Employing The No-Finder ModeAnd The Automatic Or Manual Modes Of the Multi-Mode Bar Code ReadingSubsystem;

Programmable Mode of Operation No. 13—Semi-Automatic-TriggeredMultiple-Attempt 1 D/2 D Multiple-Read Mode Employing The No-Finder ModeAnd The Automatic Or Manual Modes Of the Multi-Mode Bar Code ReadingSubsystem;

Programmable Mode of Operation No. 14—Semi-Automatic-TriggeredMultiple-Attempt 1 D/2 D Multiple-Read Mode Employing The No-Finder ModeAnd The Omniscan Modes Of the Multi-Mode Bar Code Reading Subsystem;

Programmable Mode of Operation No. 15Continuously-Automatically-Triggered Multiple-Attempt 1 D/2 DMultiple-Read Mode Employing The Automatic, Manual and/or Omniscan ModesOf the Multi-Mode Bar Code Reading Subsystem;

Programmable Mode of System Operation No. 16—Diagnostic Mode OfImaging-Based Bar Code Reader Operation; and

Programmable Mode of System Operation No. 17—Live Video Mode OfImaging-Based Bar Code Reader Operation;

FIG. 27A is a schematic representation specifying the four modes ofillumination produced from the Multi-Mode Illumination Subsystememployed in the second illustrative embodiment of the DigitalImaging-Based Bar Code Symbol Reader of the present invention, whichsupports both near and far fields of narrow-area illumination generatedduring the narrow-area image capture mode of its Multi-Mode ImageFormation and Detection Subsystem;

FIG. 27B is a schematic representation specifying how the cylindricalbeam shaping optics employed within near-field and far-field narrow-areaillumination arrays can be easily tailored to generate near and farnarrow-area illumination fields having geometrical characteristics thatenables (i) simple reading of extended-length bar code symbols withinthe far-field region of the FOV of the system, and also (ii) simplereading of bar code menus with a great degree of control within thenear-field region of the FOV, preferably during a“Semi-Automatic-Triggered” programmed mode of system operation;

FIG. 28 is a schematic representation illustrating the physicalarrangement of LEDs and light focusing lenses associated with the nearand far field narrow-area and wide-area illumination arrays employed inthe digital imaging-based bar code reading device according to thesecond illustrative embodiment of the present invention;

FIG. 29A is a first perspective view of a second illustrative embodimentof the portable POS digital imaging-based bar code reading device of thepresent invention, shown having a hand-supportable housing of adifferent form factor than that of the first illustrative embodiment,and configured for use in its hands-free/presentation mode of operation,supporting primarily wide-area image capture;

FIG. 29B is a second perspective view of the second illustrativeembodiment of the portable POS digital imaging-based bar code readingdevice of the present invention, shown configured and operated in itshands-free/presentation mode of operation, supporting primarilywide-area image capture;

FIG. 29C is a third perspective view of the second illustrativeembodiment of the portable digital imaging-based bar code reading deviceof the present invention, shown configured and operated in a hands-ontype mode, supporting both narrow and wide area modes of image capture;

FIG. 30 is a perspective view of a third illustrative embodiment of thedigital imaging-based bar code reading device of the present invention,realized in the form of a Multi-Mode Image Capture And Processing Enginethat can be readily integrated into various kinds of informationcollection and processing systems, including wireless portable dataterminals (PDTs), reverse-vending machines, retail product informationkiosks and the like;

FIG. 31 is a schematic representation of a wireless bar code-drivenportable data terminal embodying the imaging-based bar code symbolreading engine of the present invention, shown configured and operatedin a hands-on mode;

FIG. 32 is a perspective view of the wireless bar code-driven portabledata terminal of FIG. 31 shown configured and operated in a hands-onmode, wherein the imaging-based bar code symbol reading engine embodiedtherein is used to read a bar code symbol on a package and the symbolcharacter data representative of the read bar code is beingautomatically transmitted to its cradle-providing base station by way ofan RF-enabled 2-way data communication link;

FIG. 33 is a side view of the wireless bar code-driven portable dataterminal of FIGS. 31 and 32 shown configured and operated in ahands-free mode, wherein the imaging-based bar code symbol readingengine is configured in a wide-area image capture mode of operation,suitable for presentation-type bar code reading at point of sale (POS)environments;

FIG. 34 is a block schematic diagram showing the various subsystemblocks associated with a design model for the Wireless Hand-SupportableBar Code Driven Portable Data Terminal System of FIGS. 31, 32 and 33,shown interfaced with possible host systems and/or networks;

FIG. 35 is a schematic block diagram representative of a system designfor the hand-supportable digital imaging-based bar code symbol readingdevice according to an alternative embodiment of the present invention,wherein the system design is similar to that shown in FIG. 2A1, exceptthat the Automatic Light Exposure Measurement and Illumination ControlSubsystem is adapted to measure the light exposure on a central portionof the CMOS image sensing array and control the operation of theLED-Based Multi-Mode Illumination Subsystem in cooperation with asoftware-based illumination metering program realized within theMulti-Mode Image Processing Based Bar Code Symbol Reading Subsystem,involving the real-time analysis of captured digital images forunacceptable spatial-intensity distributions;

FIG. 35A is a schematic representation of the system illustrated in FIG.35, showing in greater detail how the current illumination durationdetermined by the Automatic Light Exposure Measurement and IlluminationControl Subsystem is automatically over-ridden by the illuminationduration computed by a software-implemented, image-processing basedillumination metering program carried out within the Image-ProcessingBased Bar Code Symbol Reading Subsystem, and used to control theillumination produced during the next image frame captured by thesystem, in accordance with this enhanced auto-illumination controlscheme of the present invention;

FIG. 36 is a flow chart setting forth the steps involved in carrying outthe enhanced auto-illumination control scheme illustrated in FIG. 35A;

FIG. 37 is a perspective view of a hand-supportable image-processingbased bar code symbol reader employing an image cropping zone (ICZ)targeting/marking pattern, and automatic post-image capture croppingmethods to abstract the ICZ within which the targeted object to beimaged has been encompassed during illumination and imaging operations;

FIG. 38 is a schematic system diagram of the hand-supportableimage-processing based bar code symbol reader shown in FIG. 37, shownemploying an image cropping zone (ICZ) illumination targeting/markingsource(s) operated under the control of the System Control Subsystem;

FIG. 39 is a flow chart setting forth the steps involved in carrying outthe image cropping zone targeting/marking and post-image capturecropping process of the present invention embodied within the bar codesymbol reader illustrated in FIGS. 37 and 38;

FIGS. 40A through 40E are graphical representations used in describingthe method of designing the image formation (i.e. camera) optics withinthe image-based bar code reader of the present invention using themodulation transfer function (MTF).

DETAILED DESCRIPTION OF THE ILLUSTRATIVE EMBODIMENTS OF THE PRESENTINVENTION

Referring to the figures in the accompanying Drawings, the variousillustrative embodiments of the hand-supportable imaging-based bar codesymbol reading system of the present invention will be described ingreat detail, wherein like elements will be indicated using likereference numerals.

Hand-Supportable Digital Imaging-Based Bar Code Reading Device of theFirst Illustrative Embodiment of the Present Invention

Referring to FIGS. 1A through 1K, the hand-supportable digitalimaging-based bar code symbol reading device of the first illustrativeembodiment of the present invention 1 is shown in detail comprising ahand-supportable housing 2 having a handle portion 2A and a head portion2B that is provided with a light transmission window 3 with a high-pass(red-wavelength reflecting) optical filter element 4A having lighttransmission characteristics set forth in FIG. 6A2, in the illustrativeembodiment. As will be described in greater detail hereinafter,high-pass optical filter element 4A cooperates within an interiorlymounted low-pass optical filter element 4B characterized in FIG. 6A1,which cooperates with the high-pass optical filter element 4A. Thesehigh and low pass filter elements 4A and 4B cooperate to provide anarrow-band optical filter system 4 that integrates with the headportion of the housing and permits only a narrow band of illumination(e.g. 633 nanometers) to exit and enter the housing during imagingoperations.

As is best shown in FIGS. 1I, 1J, and 1K, the hand-supportable housing 2of the illustrative embodiment comprises: left and right housing handlehalves 2A1 and 2A2; a foot-like structure 2A3 which is mounted betweenthe handle halves 2A1 and 2A2; a trigger switch structure 2C which snapfits within and pivots within a pair of spaced apart apertures 2D1 and2D2 provided in the housing halves; a light transmission window panel 5through which light transmission window 3 is formed and supported withina recess formed by handle halves 2A1 and 2A2 when they are broughttogether, and which supports all LED illumination arrays provided by thesystem; an optical bench 6 for supporting electro-optical components andoperably connected to an orthogonally-mounted PC board 7 which ismounted within the handle housing halves; a top housing portion 2B1 forconnection with the housing handle halves 2A1 and 2A2 and enclosing thehead portion of the housing; light pipe lens element 8 for mounting overan array of light emitting diodes (LEDs) 9 and light pipe structures 10mounted within the rear end of the head portion of the hand-supportablehousing; and a front bumper structure 2E for holding together the tophousing portion 2B1 and left and right handle halves 2A1 and 2A2 withthe light transmission window panel 5 sandwiched therebetween, whileproviding a level of shock protection thereto.

In other embodiments of the present invention shown in FIGS. 27 through33 the form factor of the hand-supportable housing might be different.In yet other applications, the housing need not even behand-supportable, but rather might be designed for stationary support ona desktop or countertop surface, or for use in a commercial orindustrial application.

Schematic Block Functional Diagram as System Design Model for theHand-Supportable Digital Image-Based Bar Code Reading Device of thePresent Invention

As is shown in the system design model of FIG. 2A1, the hand-supportableDigital Imaging-Based Bar Code Symbol Reading Device 1 of theillustrative embodiment comprises: an IR-based Object Presence and RangeDetection Subsystem 12; a Multi-Mode Area-type Image Formation andDetection (i.e. camera) Subsystem 13 having a narrow-area mode of imagecapture, a near-field wide-area mode of image capture, and a far-fieldwide-area mode of image capture; a Multi-Mode LED-Based IlluminationSubsystem 14 having a narrow-area mode of illumination, a near-fieldwide-area mode of illumination, and a far-field wide-area mode ofillumination; an Automatic Light Exposure Measurement and IlluminationControl Subsystem 15; an Image Capturing and Buffering Subsystem 16; aMulti-Mode Image-Processing Bar Code Symbol Reading Subsystem 17 havingfive modes of image-processing based bar code symbol reading indicatedin FIG. 2A2 and to be described in detail hereinabove; an Input/OutputSubsystem 18; a manually-actuatable trigger switch 2C for sendinguser-originated control activation signals to the device; a System ModeConfiguration Parameter Table 70; and a System Control Subsystem 18integrated with each of the above-described subsystems, as shown.

The primary function of the IR-based Object Presence and Range DetectionSubsystem 12 is to automatically produce an IR-based object detectionfield 20 within the FOV of the Multi-Mode Image Formation and DetectionSubsystem 13, detect the presence of an object within predeterminedregions of the object detection field (20A, 20B), and generate controlactivation signals A1 which are supplied to the System Control Subsystem19 for indicating when and where an object is detected within the objectdetection field of the system.

In the first illustrative embodiment, the Multi-Mode Image Formation AndDetection (I.E. Camera) Subsystem 13 has image formation (camera) optics21 for producing a field of view (FOV) 23 upon an object to be imagedand a CMOS area-image sensing array 22 for detecting imaged lightreflected off the object during illumination and imageacquisition/capture operations.

In the first illustrative embodiment, the primary function of theMulti-Mode LED-Based Illumination Subsystem 14 is to produce anarrow-area illumination field 24, near-field wide-area illuminationfield 25, and a far-field wide-area illumination field 25, each having anarrow optical-bandwidth and confined within the FOV of the Multi-ModeImage Formation And Detection Subsystem 13 during narrow-area andwide-area modes of imaging, respectively. This arrangement is designedto ensure that only light transmitted from the Multi-Mode IlluminationSubsystem 14 and reflected from the illuminated object is ultimatelytransmitted through a narrow-band transmission-type optical filtersubsystem 4 realized by (1) high-pass (i.e. red-wavelength reflecting)filter element 4A mounted at the light transmission aperture 3immediately in front of panel 5, and (2) low-pass filter element 4Bmounted either before the image sensing array 22 or anywhere after panel5 as shown in FIG. 3C. FIG. 6A4 sets forth the resulting compositetransmission characteristics of the narrow-band transmission spectralfilter subsystem 4, plotted against the spectral characteristics of theemission from the LED illumination arrays employed in the Multi-ModeIllumination Subsystem 14.

The primary function of the narrow-band integrated optical filtersubsystem 4 is to ensure that the CMOS image sensing array 22 onlyreceives the narrow-band visible illumination transmitted by the threesets of LED-based illumination arrays 27, 28 and 29 driven by LED drivercircuitry 30 associated with the Multi-Mode Illumination Subsystem 14,whereas all other components of ambient light collected by the lightcollection optics are substantially rejected at the image sensing array22, thereby providing improved SNR thereat, thus improving theperformance of the system.

The primary function of the Automatic Light Exposure Measurement andIllumination Control Subsystem 15 is to twofold: (1) to measure, inreal-time, the power density [joules/cm] of photonic energy (i.e. light)collected by the optics of the system at about its image sensing array22, and to generate Auto-Exposure Control Signals indicating the amountof exposure required for good image formation and detection; and (2) incombination with Illumination Array Selection Control Signal provided bythe System Control Subsystem 19, automatically drive and control theoutput power of selected LED arrays 27, 28 and/or 29 in the Multi-ModeIllumination Subsystem, so that objects within the FOV of the system areoptimally exposed to LED-based illumination and optimal images areformed and detected at the image sensing array 22.

The primary function of the Image Capturing and Buffering Subsystem 16is to (1) detect the entire 2-D image focused onto the 2 D image sensingarray 22 by the image formation optics 21 of the system, (2) generate aframe of digital pixel data 31 for either a selected region of interestof the captured image frame, or for the entire detected image, and then(3) buffer each frame of image data as it is captured. Notably, in theillustrative embodiment, a single 2 D image frame (31) is capturedduring each image capture and processing cycle, or during a particularstage of a processing cycle, so as to eliminate the problems associatedwith image frame overwriting, and synchronization of image capture anddecoding processes, as addressed in U.S. Pat. Nos. 5,932,862 and5,942,741 assigned to Welch Allyn, and incorporated herein by reference.

The primary function of the Multi-Mode Imaging-Based Bar Code SymbolReading Subsystem 17 is to process images that have been captured andbuffered by the Image Capturing and Buffering Subsystem 16, during bothnarrow-area and wide-area illumination modes of system operation. Suchan image processing operation includes image-based bar code decodingmethods illustrated in FIGS. 14 through 25, and described in detailhereinafter.

The primary function of the Input/Output Subsystem 18 is to supportstandard and/or proprietary communication interfaces with external hostsystems and devices, and output processed image data and the like tosuch external host systems or devices by way of such interfaces.Examples of such interfaces, and technology for implementing the same,are given in U.S. Pat. No. 6,619,549, incorporated herein by referencein its entirety.

The primary function of the System Control Subsystem 19 is to providesome predetermined degree of control or management signaling services toeach subsystem component integrated, as shown. While this subsystem canbe implemented by a programmed microprocessor, in the illustrativeembodiment, it is implemented by the three-tier software architecturesupported on a computing platform shown in FIG. 2B, and as representedin FIGS. 11A through 13L, and described in detail hereinafter.

The primary function of the manually-activatable Trigger Switch 2Cintegrated with the hand-supportable housing is to enable the user togenerate a control activation signal upon manually depressing theTrigger Switch 2C, and to provide this control activation signal to theSystem Control Subsystem 19 for use in carrying out its complex systemand subsystem control operations, described in detail herein.

The primary function of the System Mode Configuration Parameter Table 70is to store (in non-volatile/persistent memory) a set of configurationparameters for each of the available Programmable Modes of SystemOperation specified in the Programmable Mode of Operation Table shown inFIGS. 26A and 26B, and which can be read and used by the System ControlSubsystem 19 as required during its complex operations.

The detailed structure and function of each subsystem will now bedescribed in detail above.

Schematic Diagram as System Implementation Model for theHand-Supportable Digital Imaging-Based Bar Code Reading Device of thePresent Invention

FIG. 2B shows a schematic diagram of a system implementation for thehand-supportable Digital Imaging-Based Bar Code Symbol Reading Device 1illustrated in FIGS. 1A through 1L. As shown in this systemimplementation, the bar code symbol reading device is realized using anumber of hardware components comprising: an illumination board 33carrying components realizing electronic functions performed by theLED-Based Multi-Mode Illumination Subsystem 14 and Automatic LightExposure Measurement and Illumination Control Subsystem 15; a CMOScamera board 34 carrying high resolution (1280×1024 8-bit 6 micron pixelsize) CMOS image sensing array 22 running at 25 Mhz master clock, at 7frames/second at 1280*1024 resolution with randomly accessible region ofinterest (ROI) window capabilities, realizing electronic functionsperformed by the Multi-Mode Image Formation and Detection Subsystem 13;a CPU board 35 (i.e. computing platform) including (i) an Intel Sabinal32-Bit Microprocessor PXA210 36 running at 200 mHz 1.0 core voltage witha 16 bit 100 Mhz external bus speed, (ii) an expandable (e.g. 8+megabyte) Intel J3 Asynchronous 16-bit Flash memory 37, (iii) a 16Megabytes of 100 MHz SDRAM 38, (iv) an Xilinx Spartan II FPGA FIFO 39running at 50 Mhz clock frequency and 60 MB/Sec data rate, configured tocontrol the camera timings and drive an image acquisition process, (v) amultimedia card socket 40, for realizing the other subsystems of thesystem, (vi) a power management module 41 for the MCU adjustable by theI2C bus, and (vii) a pair of UARTs 42A and 42B (one for an IRDA port andone for a JTAG port); an interface board 43 for realizing the functionsperformed by the I/O subsystem 18; and an IR-based object presence andrange detection circuit 44 for realizing Subsystem 12.

In the illustrative embodiment, the image formation optics 21 supportedby the bar code reader provides a field of view of 103 mm at the nominalfocal distance to the target, of approximately 70 mm from the edge ofthe bar code reader. The minimal size of the field of view (FOV) is 62mm at the nominal focal distance to the target of approximately 10 mm.Preliminary tests of the parameters of the optics are shown on FIG. 4B(the distance on FIG. 4B is given from the position of the image sensingarray 22, which is located inside the bar code symbol readerapproximately 80 mm from the edge). As indicated in FIG. 4C, the depthof field of the image formation optics varies from approximately 69 mmfor the bar codes with resolution of 5 mils per narrow module, to 181 mmfor the bar codes with resolution of 13 mils per narrow module.

The Multi-Mode Illumination Subsystem 14 is designed to cover theoptical field of view (FOV) 23 of the bar code symbol reader withsufficient illumination to generate high-contrast images of bar codeslocated at both short and long distances from the imaging window. Theillumination subsystem also provides a narrow-area (thin height)targeting beam 24 having dual purposes: (a) to indicate to the userwhere the optical view of the reader is; and (b) to allow a quick scanof just a few lines of the image and to attempt a super-fast bar codedecoding if the bar code is aligned properly. If the bar code is notaligned for a linearly illuminated image to decode, then the entirefield of view is illuminated with a wide-area illumination field 25 or26 and the image of the entire field of view is acquired by ImageCapture and Buffering Subsystem 16 and processed by the Multi-Mode BarCode Symbol Reading Subsystem 17, to ensure reading of a bar code symbolpresented therein regardless of its orientation.

The interface board 43 employed within the bar code symbol readerprovides the hardware communication interfaces for the bar code symbolreader to communicate with the outside world. The interfaces implementedin the system will typically include RS232, keyboard wedge, and/or USB,or some combination of the above, as well as others required or demandedby the particular application at hand.

Specification of the Area-Type Image Formation and Detection (i.e.Camera) Subsystem During its Narrow-Area (Linear) and Wide-Area Modes ofImaging Supported by the Narrow and Wide Area Fields of Narrow-BandIllumination, Respectively

As shown in FIGS. 3B through 3E, the Multi-Mode Image Formation AndDetection (IFD) Subsystem 13 has a narrow-area image capture mode (i.e.where only a few central rows of pixels about the center of the imagesensing array are enabled) and a wide-area image capture mode ofoperation (i.e. where all pixels in the image sensing array areenabled). The CMOS image sensing array 22 in the Image Formation andDetection Subsystem 13 has image formation optics 21 which provides theimage sensing array with a field of view (FOV) 23 on objects to beilluminated and imaged. As shown, this FOV is illuminated by theMulti-Mode Illumination Subsystem 14 integrated within the bar codereader.

The Multi-Mode Illumination Subsystem 14 includes three differentLED-based illumination arrays 27, 28 and 29 mounted on the lighttransmission window panel 5, and arranged about the light transmissionwindow 4A. Each illumination array is designed to illuminate a differentportion of the FOV of the bar code reader during different modes ofoperation. During the narrow-area (linear) illumination mode of theMulti-Mode Illumination Subsystem 14, the central narrow-wide portion ofthe FOV indicated by 23 is illuminated by the narrow-area illuminationarray 27, shown in FIG. 3A. During the near-field wide-area illuminationmode of the Multi-Mode Illumination Subsystem 14, which is activated inresponse to the IR Object Presence and Range Detection Subsystem 12detecting an object within the near-field portion of the FOV, thenear-field wide-area portion of the FOV is illuminated by the near-fieldwide-area illumination array 28, shown in FIG. 3A. During the far-fieldwide-area illumination mode of the Multi-Mode Illumination Subsystem 14,which is activated in response to the IR Object Presence and RangeDetection Subsystem 12 detecting an object within the far-field portionof the FOV, the far-field wide-area portion of the FOV is illuminated bythe far-field wide-area illumination array 29, shown in FIG. 3A. In FIG.3A, the spatial relationships are shown between these fields ofnarrow-band illumination and the far and near field portions the of FOVof the Image Formation and Detection Subsystem 13.

In FIG. 3B, the Multi-Mode LED-Based Illumination Subsystem 14 is showntransmitting visible narrow-band illumination through its narrow-bandtransmission-type optical filter subsystem 4, shown in FIG. 3C andintegrated within the hand-supportable Digital Imaging-Based Bar CodeSymbol Reading Device. The narrow-band illumination from the Multi-ModeIllumination Subsystem 14 illuminates an object with the FOV of theimage formation optics of the Image Formation and Detection Subsystem13, and light rays reflected and scattered therefrom are transmittedthrough the high-pass and low-pass optical filters 4A and 4B and areultimately focused onto image sensing array 22 to form a focuseddetected image thereupon, while all other components of ambient lightare substantially rejected before reaching image detection at the imagesensing array 22. Notably, in the illustrative embodiment, thered-wavelength reflecting high-pass optical filter element 4A ispositioned at the imaging window of the device before the imageformation optics 21, whereas the low-pass optical filter element 4B isdisposed before the image sensing array 22 between the focusing lenselements of the image formation optics 21. This forms narrow-bandoptical filter subsystem 4 which is integrated within the bar codereader to ensure that the object within the FOV is imaged at the imagesensing array 22 using only spectral components within the narrow-bandof illumination produced from Subsystem 14, while rejectingsubstantially all other components of ambient light outside this narrowrange (e.g. 15 nm).

As shown in FIG. 3D, the Image Formation And Detection Subsystem 14employed within the hand-supportable image-based bar code reading devicecomprising three lenses 21A, 21B and 21C, each made as small as possible(with a maximum diameter of 12 mm), having spherical surfaces, and madefrom common glass, e.g. LAK2 (˜LaK9), ZF10 (=SF8), LAF2 (˜LaF3).Collectively, these lenses are held together within a lens holdingassembly 45, as shown in FIG. 3E, and form an image formation subsystemarranged along the optical axis of the CMOS image sensing array 22 ofthe bar code reader.

As shown in FIG. 3E, the lens holding assembly 45 comprises: a barrelstructure 45A1, 45A2 for holding lens elements 21A, 21B and 21C; and abase structure 45B for holding the image sensing array 22; wherein theassembly is configured so that the barrel structure 45A slides withinthe base structure 45B so as to focus the fixed-focus lens assemblyduring manufacture.

In FIGS. 3F1 and 3F2, the lens holding assembly 45 and imaging sensingarray 22 are mounted along an optical path defined along the centralaxis of the system. In the illustrative embodiment, the image sensingarray 22 has, for example, a 1280×1024 pixel resolution (½″ format), 6micron pixel size, with randomly accessible region of interest (ROI)window capabilities. It is understood, though, that many other kinds ofimaging sensing devices (e.g. CCD) can be used to practice theprinciples of the present invention disclosed herein, without departingfrom the scope or spirit of the present invention.

Method of Designing the Image Formation (i.e. Camera) Optics within theImage-Based Bar Code Reader of the Present Invention Using theModulation Transfer Function (MTF)

The function of the image formation (i.e. camera) optics in the ImageFormation and Detection Subsystem 13 is to form and project, asaccurately as possible, an image of the object being formed on the imagesensing array 22. In practice, it is impossible to get an absolutelyperfect image reproduction of the object with no loss of information,because the quality of the image is limited by various effects. Theseeffects include: (i) diffraction, always present in even the very bestlenses; (ii) aberrations which, if present, can generally only beminimized, not eliminated; (iii) variation of the distance to theobject, especially if the lens cannot dynamically adjust its focus; andso on. Before spending time and money to produce a lens assembly, it isnecessary to determine that a given lens design for the bar code symbolreader of the present invention will perform well enough to satisfy therequirements of the application. Thus, it will be extremely helpful to(i) establish one or more design criteria to quantify the lensperformance, and (ii) optimize the design around these criteria untilthe desired performance is achieved.

The preferred criterion for designing the image formation optics in thesystem hereof is the modulation transfer function, or MTF. The MTFprovides a measure of the contrast present in an object or image.Qualitatively, contrast may be thought of as the difference betweenlight and dark regions in the object or image. The greater thedifference in “brightness” between two regions of the object or image,the greater the contrast, as illustrated in the figure below, wherecontrast increases from left to right, as shown in FIG. 40A. Consideringthe image, given the data from the image sensor, a quantitativetreatment is possible. On the common 8 bit scale, a pixel that istotally black is assigned the value 0, while a pixel that is totallysaturated white is assigned the value 255. Therefore, an image thatappears as shown in FIG. 40B may also be represented by a plot of itspixel values, as shown in FIG. 40C. If this were a representation of atarget object, then the resulting image would be different. Namely, dueto the various effects described above, the contrast would not beexactly preserved. In other words, the closer the spacing of the objectfeatures, then the worse the reproduction of that contrast in the imageof the object. Therefore, the image of the object might appear somethinglike the graphical representation set forth in FIG. 40D and a plot ofthe values something like the following graphical representation shownin FIG. 40E.

A mathematical expression is required to quantify the amount of contrastpresent in an object or image, so that its variation after imagingthrough the optics may be assessed. A useful contrast measure can bedefined as the modulation M of a given region in the object, given asfollows:

$M = \frac{{\max\mspace{14mu}{value}} - {\min\mspace{14mu}{value}}}{{\max\mspace{14mu}{value}} + {\min\mspace{14mu}{value}}}$The greater the contrast in the object or image, the greater the valueof M, up to a maximum of 1. On the other hand, no contrast whatever inthe object or image (i.e. no distinguishable features in the region ofthe object in question) yields a modulation of 0. To determine how wellthe image formation optics preserves the modulation of the target objectin the image, it is only necessary to form a ratio of the imagemodulation to the object modulation, which is the MTF:

${MTF} = \frac{{image}\mspace{14mu}{modulation}}{{object}\mspace{14mu}{modulation}}$Perfect reproduction of the object contrast in the image (impossible inpractice) results in an MTF of 1. A total loss of the object contrast inthe image gives an MTF of 0.

The MTF is a useful concept in optical design because it simultaneouslyaccounts for the impact of any effect that degrades the quality of theimage, usually referred to as blurring. As described previously, theseeffects include diffraction, aberrations (spherical, chromatic, coma,astigmatism, field curvature) and deviation of the object distance fromits nominal value. It should be mentioned for sake of completeness,however, that MTF is not a single perfect or all-encompassing measure ofimage quality. One potential drawback is that examining the MTF revealsonly the total impact of all effects simultaneously, and cannotdistinguish between blurring caused by one defect or another. If it isnecessary to determine what effects are degrading the MTF, and to whatextent for each, then other methods must be used, and other criteriaexamined. In addition, there are potentially negative imagecharacteristics, such as distortion, that are not revealed at all by theMTF. If the optical designer is not careful, then it is possible that animage with an MTF close to the diffraction limit, which is as good as itis possible to get, may have distortion so bad that it is unusable inthe application at hand.

In accordance with the design method of the present invention, aftercalculating the MTF for a given optical design, an additional criterionis necessary to specify what MTF is good enough for the application inquestion. For bar code decoding applications, a useful rule of thumb isthat 0.3 MTF or better is needed for decoding software to work reliablywell in an Imaging-Based Bar Code Symbol Reader. The design strategyemployed on the Imaging-Based Bar Code Symbol Reader of the presentinvention is to determine, as a function of object distance, the codeelement size (in millimeters) at which the MTF of the resulting imagefalls to 0.3. In other words, at each object distance, the opticaldesigner should determine what is the smallest size of the code element(in millimeters) that can be imaged well enough to be read by theMulti-Mode Image-Processing Bar Code Reading Subsystem 17 of the presentinvention. At one stage of the design of the image formation opticsemployed in the illustrative embodiment, the plot of minimum codeelement size against object distance appeared. Given such a plot, theoptical design team needs to determine whether or not the resulting barcode reader performance satisfies the requirements of the application athand. To help make this determination, an advanced optical design methodand tool described below can be used with excellent results.

Method of Theoretically Characterizing the Dof of the Image FormationOptics Employed in the Imaging-Based Bar Code Reader of the PresentInvention

Referring to FIGS. 4D through 4I3, a novel software-enabled design tooland method will now be described.

In general, the software-enabled optical design tool provides a novelway of and means for completely theoretically characterizing, andgraphically viewing and interpreting the composite DOF of imageformation optics (e.g. such as 21 employed in the Imaging-Based Bar CodeSymbol Reader of the present invention) as well as other imaging-basedoptical readers, while simultaneously accounting for optical performanceand image sensor limitations, over all desired object distances and forall desired code mil sizes.

Given an arrangement of lens elements for the design of the imageformation optics 21, the optical design method of the present inventioninvolves using a software-based optical design tool, as described inFIGS. 4I1 through 4I3, to generate the composite DOF chart in accordancewith the present invention. The functions required by this opticaldesign tool will be described below. The software-based optical designtool (i.e. computer program) of the illustrative embodiment, describedin FIGS. 4I1 through 4I3, has been developed using Zemaxφ opticalmodeling software, programmed in ZPL (Zemax Programming Language) inaccordance with the principles of the present invention described indetail below.

The first function required by the optical design tool of the presentinvention is that it must be able to calculate the modulation transferfunction (MTF) of the image resulting from image formation optics 21,plotted as a function of object distance. The general industry rule ofthumb is that a 0.3 MTF is the minimum acceptable for bar code decoding.Therefore, this software-based optical design tool must be able todetermine, as a function of object distance, the objectspatial-frequency at which the MTF of the image drops to 0.3.

The second function required by the optical design tool of the presentinvention is that it must be able to convert the objectspatial-frequency to code mil size, and then this data should be plottedagainst object distance. A resulting plot is shown in FIG. 4D, where thedotted-line curve shows the optical performance of the image formationoptics, in terms of the smallest mil size code that can be decoded, at agiven object distance. FIG. 4E demonstrates how to read the DOF fromthis plot, by finding the intersections of the mil size in question withthe optical performance curve.

However, optical performance of the image formation optics is not theonly factor determining the capacity of an Imaging-Based Bar Code SymbolReader to read bar code symbols having bar code elements of a givenwidth. Image-processing based bar code symbol decoding software requiresa certain minimum number of sensor pixel “fields of view” to beprojected onto each minimum width code element, within the field of theview of the image formation optics. The general industry rule of thumbis that 1.6 pixels are required per narrow element for acceptabledecoding. In accordance with the present invention, this rule has beenexpanded to the range of 1.4 to 1.6 pixels per narrow element, and canbe considered a limit imposed by sampling theory that will restrict theultimate performance of the bar code symbol reader 1 regardless of theindividual performance of its image formation optics 21.

Therefore, the third function required by the optical design tool of thepresent invention is that it must be able to calculate, as a function ofobject distance, the size of the field of view of a single sensor pixelwhen projected through the image formation optics 21 and out into objectspace (that is, accounting for the optical magnification of the imageformation optics 21). These linear functions, both for the 1.4 and 1.6pixel rules, are preferably plotted on the same axes as the opticalperformance curve, as shown in FIG. 4F.

Having described the primary functionalities of the optical design toolof the present invention, and how to generate a composite DOF plot asshown in FIG. 4F for an imaging-based bar code symbol reader, it is nowappropriate to describe, with reference to FIG. 4G, how to determine theactual composite DOF curve, accounting for both optical performance andsampling limit, for the 1.6 pixel case. Other system information, suchas lens focal length, lens f-number, etc. may also be displayed on thecomposite DOF plot of FIG. 4G, for instance in a title block.

As shown in FIG. 4G, the method involves following the opticalperformance curve until it intersects the sampling limit line. Then, thesampling limit line is followed until it re-intersects the opticalperformance curve, at which point the optical performance curve is againfollowed. Thus, the sampling limit line of choice represents the lowerlimit of the decoding resolution of the system. Referring to FIG. 4H, asimple technique is shown for reading the DOF from the composite plot ofFIG. 4G.

Preferably, the optical design tool of the present invention will beprovided with a simple graphical user interface (GUI) which may beuseful for, supporting pop-up windows to enable the user to easily typenumbers into the program. Also, the optical design tool will preferablyimplement various methods to allow the user to specify some of therequired numbers while the program is running, as opposed to having tochange the numbers in the program file.

A less preferred alternative way of practicing the optical design methodof the present invention would be to manually construct the compositeDOF plot by examining MTF data and plotting the results in Excel, forexample. However, this approach is labor intensive and does not offerany appreciable increase in accuracy, as does the use of thesoftware-enabled optical design tool described in FIGS. 4I1 through 4I3.

Specification of Multi-Mode LED-Based Illumination Subsystem Employed inthe Hand-Supportable Image-Based Bar Code Reading System of the PresentInvention

In the illustrative embodiment, the LED-Based Multi-Mode IlluminationSubsystem 14 comprises: narrow-area illumination array 27; near-fieldwide-area illumination array 28; and far-field wide-area illuminationarray 29. The three fields of narrow-band illumination produced by thethree illumination arrays of subsystem 14 are schematically depicted inFIG. 5A1. As will be described hereinafter, with reference to FIGS. 27and 28, narrow-area illumination array 27 can be realized as twoindependently operable arrays, namely: a near-field narrow-areaillumination array and a far-field narrow-area illumination array, whichare activated when the target object is detected within the near and farfields, respectively, of the automatic IR-based Object Presence andRange Detection Subsystem 12 during wide-area imaging modes ofoperation. However, for purposes of illustration, the first illustrativeembodiment of the present invention employs only a single fieldnarrow-area (linear) illumination array which is designed to illuminateover substantially, the entire working range of the system, as shown inFIG. 5A1.

As shown in FIGS. 5B, 5C3 and 5C4, the narrow-area (linear) illuminationarray 27 includes two pairs of LED light sources 27A 1 and 27A2 providedwith cylindrical lenses 27B1 and 27B2, respectively, and mounted on leftand right portions of the light transmission window panel 5. During thenarrow-area image capture mode of the Image Formation and DetectionSubsystem 13, the narrow-area (linear) illumination array 27 producesnarrow-area illumination field 24 of narrow optical-bandwidth within theFOV of the system. In the illustrative embodiment, narrow-areaillumination field 24 has a height less than 10 mm at the far field,creating the appearance of a substantially linear or rather planarillumination field.

The near-field wide-area illumination array 28 includes two sets of(flattop) LED light sources 28A1-28A6 and 28A7-28A13 without any lensesmounted on the top and bottom portions of the light transmission windowpanel 5, as shown in FIG. 5B. During the near-field wide-area imagecapture mode of the Image Formation and Detection Subsystem 13, thenear-field wide-area illumination array 28 produces a near-fieldwide-area illumination field 25 of narrow optical-bandwidth within theFOV of the system.

As shown in FIGS. 5B, 5D3 and 5D4, the far-field wide-area illuminationarray 29 includes two sets of LED light sources 29A1-29A6 and 29A7-29A13provided with spherical (i.e. plano-convex) lenses 29B1-29B6 and29B7-29B13, respectively, and mounted on the top and bottom portions ofthe light transmission window panel 5. During the far-field wide-areaimage capture mode of the Image Formation and Detection Subsystem 13,the far-field wide-area illumination array 29 produces a far-fieldwide-area illumination beam of narrow optical-bandwidth within the FOVof the system.

Narrow-Area (Linear) Illumination Arrays Employed in the Multi-ModeIllumination Subsystem

As shown in FIG. 5A1, the narrow-area (linear) illumination field 24extends from about 30 mm to about 200 mm within the working range of thesystem, and covers both the near and far fields of the system. Thenear-field wide-area illumination field 25 extends from about 0 mm toabout 100 mm within the working range of the system. The far-fieldwide-area illumination field 26 extends from about 100 mm to about 200mm within the working range of the system. The Table shown in FIG. 5A2specifies the geometrical properties and characteristics of eachillumination mode supported by the Multi-Mode LED-based IlluminationSubsystem 14 of the present invention.

The narrow-area illumination array 27 employed in the Multi-ModeLED-Based Illumination Subsystem 14 is optically designed to illuminatea thin area at the center of the field of view (FOV) of theimaging-based bar code symbol reader, measured from the boundary of theleft side of the field of view to the boundary of its right side, asspecified in FIG. 5A1. As will be described in greater detailhereinafter, the narrow-area illumination field 24 is automaticallygenerated by the Multi-Mode LED-Based Illumination Subsystem 14 inresponse to the detection of an object within the object detection fieldof the automatic IR-based Object Presence and Range Detection Subsystem12. In general, the object detection field of the IR-based ObjectPresence and Range Detection Subsystem 12 and the FOV of the ImageFormation and Detection Subsystem 13 are spatially co-extensive and theobject detection field spatially overlaps the FOV along the entireworking distance of the imaging-based bar code symbol reader. Thenarrow-area illumination field 24, produced in response to the detectionof an object, serves a dual purpose: it provides a visual indication toan operator about the location of the optical field of view of the barcode symbol reader, thus, serving as a field of view aiming instrument;and during its image acquisition mode, the narrow-area illumination beamis used to illuminated a thin area of the FOV within which an objectresides, and a narrow 2-D image of the object can be rapidly captured(by a small number of rows of pixels in the image sensing array 22),buffered and processed in order to read any linear bar code symbols thatmay be represented therewithin.

FIG. 5C1 shows the Lambertian emittance versus wavelengthcharacteristics of the LEDs used to implement the narrow-areaillumination array 27 in the Multi-Mode Illumination Subsystem 14. FIG.5C2 shows the Lambertian emittance versus polar angle characteristics ofthe same LEDs. FIG. 5C3 shows the cylindrical lenses used before theLEDs (633 nm InGaAIP) in the narrow-area (linear) illumination arrays inthe illumination subsystem of the present invention. As shown, the firstsurface of the cylindrical lens is curved vertically to create anarrow-area (linear) illumination pattern, and the second surface of thecylindrical lens is curved horizontally to control the height of the ofthe linear illumination pattern to produce a narrow-area illuminationpattern. FIG. 5C4 shows the layout of the pairs of LEDs and twocylindrical lenses used to implement the narrow-area illumination arrayof the illumination subsystem of the present invention. In theillustrative embodiment, each LED produces a total output power of about11.7 mW under typical conditions. FIG. 5C5 sets forth a set of sixillumination profiles for the narrow-area illumination fields producedby the narrow-area illumination arrays of the illustrative embodiment,taken at 30, 40, 50, 80, 120, and 220 millimeters along the field awayfrom the imaging window (i.e. working distance) of the bar code readerof the present invention, illustrating that the spatial intensity of thearea-area illumination field begins to become substantially uniform atabout 80 millimeters. As shown, the narrow-area illumination beam isusable beginning at 40 mm from the light transmission/imaging window.

Near-Field Wide-Area Illumination Arrays Employed in the Multi-ModeIllumination Subsystem

The near-field wide-area illumination array 28 employed in the LED-BasedMulti-Mode Illumination Subsystem 14 is optically designed to illuminatea wide area over a near-field portion of the field of view (FOV) of theimaging-based bar code symbol reader, as defined in FIG. 5A1. As will bedescribed in greater detail hereinafter, the near-field wide-areaillumination field 28 is automatically generated by the LED-basedMulti-Mode Illumination Subsystem 14 in response to: (1) the detectionof any object within the near-field of the system by the IR-based ObjectPresence and Range Detection Subsystem 12; and (2) one or more of thefollowing events, including, for example: (i) failure of the imageprocessor to successfully decode process a linear bar code symbol duringthe narrow-area illumination mode; (ii) detection of code elements suchas control words associated with a 2-D bar code symbol; and/or (iii)detection of pixel data in the image which indicates that the object wascaptured in a state of focus.

In general, the object detection field of the IR-based Object Presenceand Range Detection Subsystem 12 and the FOV of the Image Formation AndDetection Subsystem 13 are spatially co-extensive and the objectdetection field spatially overlaps the FOV along the entire workingdistance of the imaging-based bar code symbol reader. The near-fieldwide-area illumination field 23, produced in response to one or more ofthe events described above, illuminates a wide area over a near-fieldportion of the field of view (FOV) of the imaging-based bar code symbolreader, as defined in FIG. 5A, within which an object resides, and a 2-Dimage of the object can be rapidly captured (by all rows of the imagesensing array 22, buffered and decode-processed in order to read any 1 Dor 2-D bar code symbols that may be represented therewithin, at anyorientation, and of virtually any bar code symbology. The intensity ofthe near-field wide-area illumination field during object illuminationand image capture operations is determined by how the LEDs associatedwith the near-field wide array illumination arrays 28 are electricallydriven by the Multi-Mode Illumination Subsystem 14. The degree to whichthe LEDs are driven is determined by the intensity of reflected lightmeasured near the image formation plane by the automatic light exposureand control subsystem 15. If the intensity of reflected light at thephotodetector of the Automatic Light Exposure Measurement andIllumination Control Subsystem 15 is weak, indicative that the objectexhibits low light reflectivity characteristics and a more intenseamount of illumination will need to be produced by the LEDs to ensuresufficient light exposure on the image sensing array 22, then theAutomatic Light Exposure Measurement and Illumination Control Subsystem15 will drive the LEDs more intensely (i.e. at higher operatingcurrents).

FIG. 5D1 shows the Lambertian emittance versus wavelengthcharacteristics of the LEDs used to implement the wide area illuminationarrays in the illumination subsystem of the present invention. FIG. 5D2shows the Lambertian emittance versus polar angle characteristics of theLEDs used to implement the near field wide-area illumination arrays inthe Multi-Mode Illumination Subsystem 14. FIG. 5D4 is the geometricallayout of LEDs used to implement the narrow wide-area illumination arrayof the Multi-Mode Illumination Subsystem 14, wherein the illuminationbeam produced therefrom is aimed by angling the lenses before the LEDsin the near-field wide-area illumination arrays of the Multi-ModeIllumination Subsystem 14. FIG. 5D5 sets forth a set of six illuminationprofiles for the near-field wide-area illumination fields produced bythe near-field wide-area illumination arrays of the illustrativeembodiment, taken at 10, 20, 30, 40, 60, and 100 millimeters along thefield away from the imaging window (i.e. working distance) of theimaging-based bar code symbol reader 1. These plots illustrate that thespatial intensity of the near-field wide-area illumination field beginsto become substantially uniform at about 40 millimeters (i.e.center:edge=2:1 max).

Far-Field Wide-Area Illumination Arrays Employed in the Multi-ModeIllumination Subsystem

The far-field wide-area illumination array 26 employed in the Multi-ModeLED-based Illumination Subsystem 14 is optically designed to illuminatea wide area over a far-field portion of the field of view (FOV) of theimaging-based bar code symbol reader, as defined in FIG. 5A1. As will bedescribed in greater detail hereinafter, the far-field wide-areaillumination field 26 is automatically generated by the LED-BasedMulti-Mode Illumination Subsystem 14 in response to: (1) the detectionof any object within the near-field of the system by the IR-based ObjectPresence and Range Detection Subsystem 12; and (2) one or more of thefollowing events, including, for example: (i) failure of the imageprocessor to successfully decode process a linear bar code symbol duringthe narrow-area illumination mode; (ii) detection of code elements suchas control words associated with a 2-D bar code symbol; and/or (iii)detection of pixel data in the image which indicates that the object wascaptured in a state of focus. In general, the object detection field ofthe IR-based Object Presence and Range Detection Subsystem 12 and theFOV 23 of the image detection and formation subsystem 13 are spatiallyco-extensive and the object detection field 20 spatially overlaps theFOV 23 along the entire working distance of the imaging-based bar codesymbol reader. The far-field wide-area illumination field 26, producedin response to one or more of the events described above, illuminates awide area over a far-field portion of the field of view (FOV) of theimaging-based bar code symbol reader, as defined in FIG. 5A, withinwhich an object resides, and a 2-D image of the object can be rapidlycaptured (by all rows of the image sensing array 22), buffered andprocessed in order to read any 1 D or 2-D bar code symbols that may berepresented therewithin, at any orientation, and of virtually any barcode symbology. The intensity of the far-field wide-area illuminationfield during object illumination and image capture operations isdetermined by how the LEDs associated with the far-field wide-areaillumination array 29 are electrically driven by the Multi-ModeIllumination Subsystem 14. The degree to which the LEDs are driven (i.e.measured in terms of junction current) is determined by the intensity ofreflected light measured near the image formation plane by the AutomaticLight Exposure Measurement and Illumination Control Subsystem 15. If theintensity of reflected light at the photo-detector of the AutomaticLight Exposure Measurement and Illumination Control Subsystem 15 isweak, indicative that the object exhibits low light reflectivitycharacteristics and a more intense amount of illumination will need tobe produced by the LEDs to ensure sufficient light exposure on the imagesensing array 22, then the Automatic Light Exposure Measurement andIllumination Control Subsystem 15 will drive the LEDs more intensely(i.e. at higher operating currents).

During both near and far field wide-area illumination modes ofoperation, the Automatic Light Exposure Measurement and IlluminationControl Subsystem (i.e. module) 15 measures and controls the timeduration which the Multi-Mode Illumination Subsystem 14 exposes theimage sensing array 22 to narrow-band illumination (e.g. 633 nanometers,with approximately 15 nm bandwidth) during the imagecapturing/acquisition process, and automatically terminates thegeneration of such illumination when such computed time durationexpires. In accordance with the principles of the present invention,this global exposure control process ensures that each and everyacquired image has good contrast and is not saturated, two conditionsessential for consistent and reliable bar code reading

FIG. 5D1 shows the Lambertian emittance versus wavelengthcharacteristics of the LEDs used to implement the far-field wide-areaillumination arrays 29 in the Multi-Mode Illumination Subsystem 14. FIG.5D2 shows the Lambertian emittance versus polar angle characteristics ofthe LEDs used to implement the same. FIG. 5D3 shows the plano-convexlenses used before the LEDs in the far-field wide-area illuminationarrays in the Multi-Mode Illumination Subsystem 14. FIG. 5D4 shows alayout of LEDs and plano-convex lenses used to implement the farwide-area illumination array 29 of the illumination subsystem, whereinthe illumination beam produced therefrom is aimed by angling the lensesbefore the LEDs in the far-field wide-area illumination arrays of theMulti-Mode Illumination Subsystem 14. FIG. 5D6 sets forth a set of threeillumination profiles for the far-field wide-area illumination fieldsproduced by the far-field wide-area illumination arrays of theillustrative embodiment, taken at 100, 150 and 220 millimeters along thefield away from the imaging window (i.e. working distance) of theimaging-based bar code symbol reader 1, illustrating that the spatialintensity of the far-field wide-area illumination field begins to becomesubstantially uniform at about 100 millimeters. FIG. 5D7 shows a tableillustrating a preferred method of calculating the pixel intensity valuefor the center of the far field wide-area illumination field producedfrom the Multi-Mode Illumination Subsystem 14, showing a significantsignal strength (greater than 80 DN at the far center field).

Specification of the Narrow-Band Optical Filter Subsystem Integratedwithin the Hand-Supportable Housing of the Imager of the PresentInvention

As shown in FIG. 6A1, the hand-supportable housing of the bar codereader of the present invention has integrated within its housing,narrow-band optical filter subsystem 4 for transmitting substantiallyonly the very narrow band of wavelengths (e.g. 620-700 nanometers) ofvisible illumination produced from the narrow-band Multi-ModeIllumination Subsystem 14, and rejecting all other optical wavelengthsoutside this narrow optical band however generated (i.e. ambient lightsources). As shown, narrow-band optical filter subsystem 4 comprises:red-wavelength reflecting (high-pass) imaging window filter 4Aintegrated within its light transmission aperture 3 formed on the frontface of the hand-supportable housing; and low pass optical filter 4Bdisposed before the CMOS image sensing array 22. These optical filters4A and 4B cooperate to form the narrow-band optical filter subsystem 4for the purpose described above. As shown in FIG. 6A2, the lighttransmission characteristics (energy versus wavelength) associated withthe low-pass optical filter element 4B indicate that optical wavelengthsbelow 620 nanometers are transmitted therethrough, whereas opticalwavelengths above 620 nm are substantially blocked (e.g. absorbed orreflected). As shown in FIG. 6A3, the light transmission characteristics(energy versus wavelength) associated with the high-pass imaging windowfilter 4A indicate that optical wavelengths above 700 nanometers aretransmitted therethrough, thereby producing a red-color appearance tothe user, whereas optical wavelengths below 700 nm are substantiallyblocked (e.g. absorbed or reflected) by optical filter 4A.

During system operation, spectral band-pass filter subsystem 4 greatlyreduces the influence of the ambient light, which falls upon the CMOSimage sensing array 22 during the image capturing operations. By virtueof the optical filter of the present invention, an optical shuttermechanism is eliminated in the system. In practice, the optical filtercan reject more than 85% of incident ambient light, and in typicalenvironments, the intensity of LED illumination is significantly morethan the ambient light on the CMOS image sensing array 22. Thus, whilean optical shutter is required in nearly most conventional CMOS imagingsystems, the imaging-based bar code reading system of the presentinvention effectively manages the exposure time of narrow-bandillumination onto its CMOS image sensing array 22 by simply controllingthe illumination time of its LED-based illumination arrays 27, 28 and 29using control signals generated by Automatic Light Exposure Measurementand Illumination Control Subsystem 15 and the CMOS image sensing array22 while controlling illumination thereto by way of the band-passoptical filter subsystem 4 described above. The result is a simplesystem design, without moving parts, and having a reduced manufacturingcost.

While the band-pass optical filter subsystem 4 is shown comprising ahigh-pass filter element 4A and low-pass filter element 4B, separatedspatially from each other by other optical components along the opticalpath of the system, subsystem 4 may be realized as an integratedmulti-layer filter structure installed in front of the image formationand detection (IFD) module 13, or before its image sensing array 22,without the use of the high-pass window filter 4A, or with the usethereof so as to obscure viewing within the imaging-based bar codesymbol reader while creating an attractive red-colored protectivewindow. Preferably, the red-color window filter 4A will havesubstantially planar surface characteristics to avoid focusing ordefocusing of light transmitted therethrough during imaging operations.

Specification of the Automatic Light Exposure Measurement andIllumination Control Subsystem of the Present Invention

The primary function of the Automatic Light Exposure Measurement andIllumination Control Subsystem 15 is to control the brightness andcontrast of acquired images by (i) measuring light exposure at the imageplane of the CMOS imaging sensing array 22 and (ii) controlling the timeduration that the Multi-Mode Illumination Subsystem 14 illuminates thetarget object with narrow-band illumination generated from the activatedLED illumination array. Thus, the Automatic Light Exposure Measurementand Illumination Control Subsystem 15 eliminates the need for a complexshuttering mechanism for CMOS-based image sensing array 22. This novelmechanism ensures that the imaging-based bar code symbol reader of thepresent invention generates non-saturated images with enough brightnessand contrast to guarantee fast and reliable image-based bar codedecoding in demanding end-user applications.

During object illumination, narrow-band LED-based light is reflectedfrom the target object (at which the hand-supportable bar code reader isaimed) and is accumulated by the CMOS image sensing array 22. Notably,the object illumination process must be carried out for an optimalduration so that the acquired image frame has good contrast and is notsaturated. Such conditions are required for the consistent and reliablebar code decoding operation and performance. The Automatic LightExposure Measurement and Illumination Control Subsystem 15 measures theamount of light reflected from the target object, calculates the maximumtime that the CMOS image sensing array 22 should be kept exposed to theactively-driven LED-based illumination array associated with theMulti-Mode Illumination Subsystem 14, and then automatically deactivatesthe illumination array when the calculated time to do so expires (i.e.lapses).

As shown in FIG. 7A of the illustrative embodiment, the Automatic LightExposure Measurement and Illumination Control Subsystem 15 comprises: aparabolic light-collecting mirror 55 mounted within the head portion ofthe hand-supportable housing, for collecting narrow-band LED-based lightreflected from a central portion of the FOV of the system, which is thentransmitted through the narrow-band optical filter subsystem 4eliminating wide band spectral interference; a light-sensing device(e.g. photo-diode) 56 mounted at the focal point of the light collectionmirror 55, for detecting the filtered narrow-band optical signal focusedtherein by the light collecting mirror 55; and an electronic circuitry57 for processing electrical signals produced by the photo-diode 56indicative of the intensity of detected light exposure levels within thefocal plane of the CMOS image sensing array 22. During light exposuremeasurement operations, incident narrow-band LED-based illumination isgathered from the center of the FOV of the system by the spherical lightcollecting mirror 55 and narrow-band filtered by the narrow-band opticalfilter subsystem 4 before being focused upon the photodiode 56 forintensity detection. The photo-diode 56 converts the detected lightsignal into an electrical signal having an amplitude which directlycorresponds to the intensity of the collected light signal.

As shown in FIG. 7B, the System Control Subsystem 19 generates anillumination array selection control signal which determines which LEDillumination array (i.e. the narrow-area illumination array 27 or thefar-field and narrow-field wide-area illumination arrays 28 or 29) willbe selectively driven at any instant in time of system operation by LEDArray Driver Circuitry 64 in the Automatic Light Exposure Measurementand Illumination Control Subsystem 15. As shown, electronic circuitry 57processes the electrical signal from photo-detector 56 and generates anauto exposure control signal for the selected LED illumination array. Inturn, this auto exposure control signal is provided to the LED arraydriver circuitry 64, along with an illumination array selection controlsignal from the System Control Subsystem 19, for selecting and driving(i.e. energizing) one or more LED illumination array(s) so as togenerate visible illumination at a suitable intensity level and for asuitable time duration so that the CMOS image sensing array 22automatically detects digital high-resolution images of illuminatedobjects, with sufficient contrast and brightness, while achieving globalexposure control objectives of the present invention disclosed herein.As shown in FIGS. 7B and 7C, the illumination array selection controlsignal is generated by the System Control Subsystem 19 in response to(i) reading the system mode configuration parameters from the systemmode configuration parameter table 70, shown in FIG. 2A1, for theprogrammed mode of system operation at hand, and (ii) detecting theoutput from the automatic IR-based Object Presence and Range DetectionSubsystem 12.

Notably, in the illustrative embodiment, there are three possibleLED-based illumination arrays 27, 28 and 29 which can be selected foractivation by the System Control Subsystem 19, and the upper and/orlower LED subarrays in illumination arrays 28 and 29 can be selectivelyactivated or deactivated on a subarray-by-subarray basis, for variouspurposes taught herein, including automatic specular reflection noisereduction during wide-area image capture modes of operation.

Each one of these illumination arrays can be driven to different statesdepending on the auto-exposure control signal generated by electronicsignal processing circuit 57, which will be generally a function ofobject distance, object surface reflectivity and the ambient lightconditions sensed at photo-detector 56, and measured by signalprocessing circuit 57. The operation of signal processing circuitry57will now be detailed below.

As shown in FIG. 7B, the narrow-band filtered optical signal that isproduced by the parabolic light focusing mirror 55 is focused onto thephoto-detector D1 56 which generates an analog electrical signal whoseamplitude corresponds to the intensity of the detected optical signal.This analog electrical signal is supplied to the signal processingcircuit 57 for various stages of processing. The first step ofprocessing involves converting the analog electrical signal from acurrent-based signal to a voltage-based signal which is achieved bypassing it through a constant-current source buffer circuit 58, realizedby one half of transistor Q1 (58). This inverted voltage signal is thenbuffered by the second half of the transistor Q1 (58) and is supplied asa first input to a summing junction 59. As shown in FIG. 7C, the CMOSimage sensing array 22 produces, as output, a digital electronic rollingshutter (ERS) pulse signal 60, wherein the duration of this ERS pulsesignal 60 is fixed to a maximum exposure time allowed in the system. TheERS pulse signal 60 is buffered through transistor Q2 61 and forms theother side of the summing junction 59. The outputs from transistors Q1and Q2 form an input to the summing junction 59. A capacitor C5 isprovided on the output of the summing junction 59 and provides a minimumintegration time sufficient to reduce any voltage overshoot in thesignal processing circuit 57. The output signal across the capacitor C5is further processed by a comparator U1 62. In the illustrativeembodiment, the comparator reference voltage signal is set to 1.7 volts.This reference voltage signal sets the minimum threshold level for thelight exposure measurement circuit 57. The output signal from thecomparator 62 is inverted by inverter U3 63 to provide a positive logicpulse signal which is supplied, as auto exposure control signal, to theinput of the LED array driver circuit 64 shown in FIG. 7C.

As will be explained in greater detail below, the LED array drivercircuit 64 shown in FIG. 7C automatically drives an activated LEDilluminated array, and the operation of LED array driver circuit 64depends on the mode of operation in which the Multi-Mode IlluminationSubsystem 14 is configured. In turn, the mode of operation in which theMulti-Mode Illumination Subsystem 14 is configured at any moment in timewill typically depend on (i) the state of operation of the ObjectPresence and Range Detection Subsystem 12 and (ii) the programmed modeof operation in which the entire Imaging-Based Bar Code Symbol ReadingSystem is configured using system mode configuration parameters readfrom Table 70 shown in FIG. 2A1.

As shown in FIG. 7C, the LED array driver circuit 64 comprises analogand digital circuitry which receives two input signals: (i) the autoexposure control signal from signal processing circuit 57; and (ii) theillumination array selection control signal. The LED array drivercircuit 64 generates, as output, digital pulse-width modulated (PCM)drive signals provided to either the narrow-area illumination array 27,the upper and/or lower LED subarray employed in the near-field wide-areaillumination array 28, and/or the upper and/or lower LED subarraysemployed in the far-field wide-area illumination array 29. Depending onwhich mode of system operation the imaging-based bar code symbol readerhas been configured, the LED array driver circuit 64 will drive one ormore of the above-described LED illumination arrays during objectillumination and imaging operations. As will be described in greaterdetail below, when all rows of pixels in the CMOS image sensing array 22are in a state of integration (and thus have a common integration time),such LED illumination array(s) are automatically driven by the LED arraydriver circuit 64 at an intensity and for a duration computed (in ananalog manner) by the Automatic Light Exposure and Illumination ControlSubsystem 15 so as to capture digital images having good contrast andbrightness, independent of the light intensity of the ambientenvironment and the relative motion of the target object with respect tothe imaging-based bar code symbol reader.

Global Exposure Control Method of the Present Invention Carried OutUsing the CMOS Image Sensing Array

In the illustrative embodiment, the CMOS image sensing array 22 isoperated in its Single Frame Shutter Mode (i.e. rather than itsContinuous Frame Shutter Mode) as shown in FIG. 7D, and employs a novelexposure control method which ensure that all rows of pixels in the CMOSimage sensing array 22 have a common integration time, thereby capturinghigh quality images even when the object is in a state of high speedmotion. This novel exposure control technique shall be referred to as“the global exposure control method” of the present invention, and theflow chart of FIGS. 7E1 and 7E2 describes clearly and in great detailhow this method is implemented in the imaging-based bar code symbolreader of the illustrative embodiment. The global exposure controlmethod will now be described in detail below

As indicated at Block A in FIG. 7E1, Step A in the global exposurecontrol method involves selecting the single frame shutter mode ofoperation for the CMOS imaging sensing array provided within animaging-based bar code symbol reading system employing an automaticlight exposure measurement and illumination control subsystem, amulti-mode illumination subsystem, and a system control subsystemintegrated therewith, and image formation optics providing the CMOSimage sensing array with a field of view into a region of space whereobjects to be imaged are presented.

As indicated in Block B in FIG. 7E1, Step B in the global exposurecontrol method involves using the automatic light exposure measurementand illumination control subsystem to continuously collect illuminationfrom a portion of the field of view, detect the intensity of thecollected illumination, and generate an electrical analog signalcorresponding to the detected intensity, for processing.

As indicated in Block C in FIG. 7E1, Step C in the global exposurecontrol method involves activating (e.g. by way of the system controlsubsystem 19 or directly by way of trigger switch 2C) the CMOS imagesensing array so that its rows of pixels begin to integrate photonicallygenerated electrical charge in response to the formation of an imageonto the CMOS image sensing array by the image formation optics of thesystem.

As indicated in Block D in FIG. 7E1, Step D in the global exposurecontrol method involves the CMOS image sensing array 22 automatically(i) generating an electronic rolling shutter (ERS) digital pulse signalwhen all rows of pixels in the image sensing array are operated in astate of integration, and providing this ERS pulse signal to theAutomatic Light Exposure Measurement And Illumination Control Subsystem15 so as to activate light exposure measurement and illumination controlfunctions/operations therewithin.

As indicated in Block E in FIG. 7E2, Step E in the global exposurecontrol method involves, upon activation of light exposure measurementand illumination control functions within Subsystem 15, (i) processingthe electrical analog signal being continuously generated therewithin,(ii) measuring the light exposure level within a central portion of thefield of view 23 (determined by light collecting optics 55 shown in FIG.7A), and (iii) generating an auto-exposure control signal forcontrolling the generation of visible field of illumination from atleast one LED-based illumination array (27, 28 and/or 29) in theMulti-Mode Illumination Subsystem 14 which is selected by anillumination array selection control signal produced by the SystemControl Subsystem 19.

Finally, as indicated at Block F in FIG. 7E2, Step F in the globalexposure control method involves using (i) the auto exposure controlsignal and (ii) the illumination array selection control signal to drivethe selected LED-based illumination array(s) and illuminate the field ofview of the CMOS image sensing array 22 in whatever image capture modeit may be configured, precisely when all rows of pixels in the CMOSimage sensing array are in a state of integration, as illustrated inFIG. 7D, thereby ensuring that all rows of pixels in the CMOS imagesensing array have a common integration time. By enabling all rows ofpixels in the CMOS image sensing array 22 to have a common integrationtime, high-speed “global exposure control” is effectively achievedwithin the imaging-based bar code symbol reader of the presentinvention, and consequently, high quality images are capturedindependent of the relative motion between the bar code symbol readerand the target object.

Specification of the IR-Based Automatic Object Presence and RangeDetection Subsystem Employed in the Hand-Supportable Digital Image-BasedBar Code Reading Device of the Present Invention

As shown in FIG. 8A, IR-wavelength based Automatic Object Presence andRange Detection Subsystem 12 is realized in the form of a compact opticsmodule 76 mounted on the front portion of optics bench 6, as shown inFIG. 1J.

As shown in FIG. 8, the object presence and range detection module 12 ofthe illustrative embodiment comprises a number of subcomponents, namely:an optical bench 77 having an ultra-small footprint for supportingoptical and electro-optical components used to implement the subsystem12; at least one IR laser diode 78 mounted on the optical bench 77, forproducing a low power IR laser beam 79; IR beam shaping optics 80,supported on the optical bench for shaping the IR laser beam (e.g. intoa pencil-beam like geometry) and directing the same into the centralportion of the object detection field 20 defined by the field of view(FOV) of IR light collection/focusing optics 81 supported on the opticalbench 77; an amplitude modulation (AM) circuit 82 supported on theoptical bench 77, for modulating the amplitude of the IR laser beamproduced from the IR laser diode at a frequency f₀ (e.g. 75 Mhz) with upto 7.5 milliwatts of optical power; optical detector (e.g. anavalanche-type IR photodetector) 83, mounted at the focal point of theIR light collection/focusing optics 81, for receiving the IR opticalsignal reflected off an object within the object detection field, andconverting the received optical signal 84 into an electrical signal 85;an amplifier and filter circuit 86, mounted on the optical bench 77, forisolating the f₀ signal component and amplifying it; a limitingamplifier 87, mounted on the optical bench, for maintaining a stablesignal level; a phase detector 88, mounted on the optical bench 77, formixing the reference signal component f₀ from the AM circuit 82 and thereceived signal component f₀ reflected from the packages and producing aresulting signal which is equal to a DC voltage proportional to theCosine of the phase difference between the reference and the reflectedf₀ signals; an amplifier circuit 89, mounted on the optical bench 77,for amplifying the phase difference signal; a received signal strengthindicator (RSSI) 90, mounted on the optical bench 77, for producing avoltage proportional to a LOG of the signal reflected from the targetobject which can be used to provide additional information; areflectance level threshold analog multiplexer 91 for rejectinginformation from the weak signals; and a 12 bit A/D converter 92,mounted on the optical bench 77, for converting the DC voltage signalfrom the RSSI circuit 90 into sequence of time-based range data elements{R_(n,i)}, taken along nT discrete instances in time, where each rangedata element R_(n,i) provides a measure of the distance of the objectreferenced from (i) the IR laser diode 78 to (ii) a point on the surfaceof the object within the object detection field 20; and range analysiscircuitry 93 described below.

In general, the function of range analysis circuitry 93 is to analyzethe digital range data from the A/D converter 90 and generate twocontrol activation signals, namely: (i) “an object presence detection”type of control activation signal A_(1A) indicating simply whether anobject is presence or absent from the object detection field, regardlessof the mode of operation in which the Multi-Mode Illumination Subsystem14 might be configured; and (ii) “a near-field/far-field” rangeindication type of control activation signal A_(1B) indicating whether adetected object is located in either the predefined near-field orfar-field portions of the object detection field, which correspond tothe near-field and far-field portions of the FOV of the Multi-Mode ImageFormation and Detection Subsystem 13.

Various kinds of analog and digital circuitry can be designed toimplement the IR-based Automatic Object Presence and Range DetectionSubsystem 12. Alternatively, this subsystem can be realized usingvarious kinds of range detection techniques as taught in U.S. Pat. No.6,637,659, incorporated herein by reference in its entirely.

In the illustrative embodiment, Automatic Object Presence and RangeDetection Subsystem 12 operates as follows. In System Modes of Operationrequiring automatic object presence and/or range detection, AutomaticObject Presence and Range Detection Subsystem 12 will be activated atsystem start-up and operational at all times of system operation,typically continuously providing the System Control Subsystem 19 withinformation about the state of objects within both the far and nearportions of the object detection field 20 of the imaging-based symbolreader. In general, this Subsystem detects two basic states of presenceand range, and therefore has two basic states of operation. In its firststate of operation, the IR-based automatic Object Presence and RangeDetection Subsystem 12 automatically detects an object within thenear-field region of the FOV 20, and in response thereto generates afirst control activation signal which is supplied to the System ControlSubsystem 19 to indicate the occurrence of this first fact. In itssecond state of operation, the IR-based automatic Object Presence andRange Detection Subsystem 12 automatically detects an object within thefar-field region of the FOV 20, and in response thereto generates asecond control activation signal which is supplied to the System ControlSubsystem 19 to indicate the occurrence of this second fact. As will bedescribed in greater detail and throughout this patent specification,these control activation signals are used by the System ControlSubsystem 19 during particular stages of the system control process,such as determining (i) whether to activate either the near-field and/orfar-field LED illumination arrays, and (ii) how strongly should theseLED illumination arrays be driven to ensure quality image exposure atthe CMOS image sensing array 22.

Specification of the Mapping of Pixel Data Captured by the Imaging Arrayinto the SDRAM Under the Control of the Direct Memory Access (DMA)Module within the Microprocessor

As shown in FIG. 9, the CMOS image sensing array 22 employed in thedigital imaging-based bar code symbol reading device hereof is operablyconnected to its microprocessor 36 through FIFO 39 (realized by way of aFPGA) and system bus shown in FIG. 2B. As shown, SDRAM 38 is alsooperably connected to the microprocessor 36 by way of the system bus,thereby enabling the mapping of pixel data captured by the CMOS imagesensing array 22 into the SDRAM 38 under the control of the directmemory access (DMA) module within the microprocessor 36.

Referring to FIG. 10, details will now be given on how the bytes ofpixel data captured by CMOS image sensing array 22 are automaticallymapped (i.e. captured and stored) into the addressable memory storagelocations of its SDRAM 38 during each image capture cycle carried outwithin the hand-supportable imaging-based bar code reading device of thepresent invention.

In the implementation of the illustrative embodiment, the CMOS imagesensing array 22 sends 8-bit gray-scale data bytes over a parallel dataconnection to FPGA 39 which implements a FIFO using its internal SRAM.The FIFO 39 stores the pixel data temporarily and the microprocessor 36initiates a DMA transfer from the FIFO (which is mapped to addressOXOCOOOOOO, chip select 3) to the SDRAM 38. In general, modernmicroprocessors have internal DMA modules, and a preferredmicroprocessor design, the DMA module will contain a 32-byte buffer.Without consuming any CPU cycles, the DMA module can be programmed toread data from the FIFO 39, store read data bytes in the DMA's buffer,and subsequently write the data to the SDRAM 38. Alternatively, a DMAmodule can reside in FPGA 39 to directly write the FIFO data into theSDRAM 38. This is done by sending a bus request signal to themicroprocessor 36, so that the microprocessor 36 releases control of thebus to the FPGA 39 which then takes over the bus and writes data intothe SDRAM 38.

Below, a brief description will be given on where pixel data output fromthe CMOS image sensing array 22 is stored in the SDRAM 38, and how themicroprocessor (i.e. implementing a decode algorithm) 36 accesses suchstored pixel data bytes. FIG. 10 represents the memory space of theSDRAM 38. A reserved memory space of 1.3 MB is used to store the outputof the CMOS image sensing array 22. This memory space is a 1:1 mappingof the pixel data from the CMOS image sensing array 22. Each byterepresents a pixel in the image sensing array 22. Memory space is amirror image of the pixel data from the image sensing array 22. Thus,when the decode program (36) accesses the memory, it is as if it isaccessing the raw pixel image of the image sensing array 22. No timecode is needed to track the data since the modes of operation of the barcode reader guarantee that the microprocessor 36 is always accessing theup-to-date data, and the pixel data sets are a true representation ofthe last optical exposure. To prevent data corruption, i.e. new datacoming in while old data are still being processed, the reserved spaceis protected by disabling further DMA access once a whole frame of pixeldata is written into memory. The DMA module is re-enabled until eitherthe microprocessor 36 has finished going through its memory, or atimeout has occurred.

During image acquisition operations, the image pixels are sequentiallyread out of the image sensing array 22. Although one may choose to readand column-wise or row-wise for some CMOS image sensors, without loss ofgenerality, the row-by-row read out of the data is preferred. The pixelimage data set is arranged in the SDRAM 38 sequentially, starting ataddress OXAOEC0000. To randomly access any pixel in the SDRAM 38 is astraightforward matter: the pixel at row y ¼ column x located is ataddress (OXAOEC0000+y×1280+x).

As each image frame always has a frame start signal out of the imagesensing array 22, that signal can be used to start the DMA process ataddress OXAOEC0000, and the address is continuously incremented for therest of the frame. But the reading of each image frame is started ataddress OXAOEC0000 to avoid any misalignment of data. Notably, however,if the microprocessor 36 has programmed the CMOS image sensing array 22to have a ROI window, then the starting address will be modified to(OXAOEC₀₀₀₀₊₁₂₈₀×R₁), where R₁ is the row number of the top left cornerof the ROI.

Specification of the Three-Tier Software Architecture of theHand-Supportable Digital Image-Based Bar Code Reading Device of thePresent Invention

As shown in FIG. 11, the hand-supportable digital imaging-based bar codesymbol reading device of the present invention 1 is provided with athree-tier software architecture comprising the following softwaremodules: (1) the Main Task module, the CodeGate Task module, theMetroset Task module, the Application Events Manager module, the UserCommands Table module, and the Command Handler module, each residingwithin the Application layer of the software architecture; (2) the TasksManager module, the Events Dispatcher module, the Input/Output Managermodule, the User Commands Manager module, the Timer Subsystem module,the Input/Output Subsystem module and the Memory Control Subsystemmodule, each residing within the System Core (SCORE) layer of thesoftware architecture; and (3) the Linux Kernal module, the Linux FileSystem module, and Device Drivers modules, each residing within theLinux Operating System (OS) layer of the software architecture.

While the operating system layer of the imaging-based bar code symbolreader is based upon the Linux operating system, it is understood thatother operating systems can be used (e.g. Microsoft Windows, Max OXS,Unix, etc), and that the design preferably provides for independencebetween the main Application Software Layer and the Operating SystemLayer, and therefore, enables of the Application Software Layer to bepotentially transported to other platforms. Moreover, the system designprinciples of the present invention provides an extensibility of thesystem to other future products with extensive usage of the commonsoftware components, which should make the design of such productseasier, decrease their development time, and ensure their robustness.

In the illustrative embodiment, the above features are achieved throughthe implementation of an event-driven multi-tasking, potentiallymulti-user, Application layer running on top of the System Core softwarelayer, called SCORE. The SCORE layer is statically linked with theproduct Application software, and therefore, runs in the ApplicationLevel or layer of the system. The SCORE layer provides a set of servicesto the Application in such a way that the Application would not need toknow the details of the underlying operating system, although alloperating system APIs are, of course, available to the application aswell. The SCORE software layer provides a real-time, event-driven,OS-independent framework for the product Application to operate. Theevent-driven architecture is achieved by creating a means for detectingevents (usually, but not necessarily, when the hardware interruptsoccur) and posting the events to the Application for processing inreal-time manner. The event detection and posting is provided by theSCORE software layer. The SCORE layer also provides the productApplication with a means for starting and canceling the software tasks,which can be running concurrently, hence, the multi-tasking nature ofthe software system of the present invention.

Specification of Software Modules within the Score Layer of the SystemSoftware Architecture Employed in Imaging-Based Bar Code Reader of thePresent Invention

The SCORE layer provides a number of services to the Application layer.

The Tasks Manager provides a means for executing and canceling specificapplication tasks (threads) at any time during the product Applicationrun.

The Events Dispatcher provides a means for signaling and delivering allkinds of internal and external synchronous and asynchronous events

When events occur, synchronously or asynchronously to the Application,the Events Dispatcher dispatches them to the Application Events Manager,which acts on the events accordingly as required by the Applicationbased on its current state. For example, based on the particular eventand current state of the application, the Application Events Manager candecide to start a new task, or stop currently running task, or dosomething else, or do nothing and completely ignore the event.

The Input/Output Manager provides a means for monitoring activities ofinput/output devices and signaling appropriate events to the Applicationwhen such activities are detected.

The Input/Output Manager software module runs in the background andmonitors activities of external devices and user connections, andsignals appropriate events to the Application Layer, which suchactivities are detected. The Input/Output Manager is a high-prioritythread that runs in parallel with the Application and reacts to theinput/output signals coming asynchronously from the hardware devices,such as serial port, user trigger switch 2C, bar code reader, networkconnections, etc. Based on these signals and optional input/outputrequests (or lack thereof) from the Application, it generatesappropriate system events, which are delivered through the EventsDispatcher to the Application Events Manager as quickly as possible asdescribed above.

The User Commands Manager provides a means for managing user commands,and utilizes the User Commands Table provided by the Application, andexecutes appropriate User Command Handler based on the data entered bythe user.

The Input/Output Subsystem software module provides a means for creatingand deleting input/output connections and communicating with externalsystems and devices

The Timer Subsystem provides a means of creating, deleting, andutilizing all kinds of logical timers.

The Memory Control Subsystem provides an interface for managing themulti-level dynamic memory with the device, fully compatible withstandard dynamic memory management functions, as well as a means forbuffering collected data. The Memory Control Subsystem provides a meansfor thread-level management of dynamic memory. The interfaces of theMemory Control Subsystem are fully compatible with standard C memorymanagement functions. The system software architecture is designed toprovide connectivity of the device to potentially multiple users, whichmay have different levels of authority to operate with the device.

The User Commands Manager, which provides a standard way of enteringuser commands, and executing application modules responsible forhandling the same. Each user command described in the User CommandsTable is a task that can be launched by the User Commands Manager peruser input, but only if the particular user's authority matches thecommand's level of security.

The Events Dispatcher software module provides a means of signaling anddelivering events to the Application Events Manager, including thestarting of a new task, stopping a currently running task, or doingsomething or nothing and simply ignoring the event.

FIG. 12B provides a Table listing examples of System-Defined Eventswhich can occur and be dispatched within the hand-supportable digitalimaging-based bar code symbol reading device of the present invention,namely: SCORE_EVENT_POWER_UP which signals the completion of systemstart-up and involves no parameters;_SCORE_EVENT_TIMEOUT which signalsthe timeout of the logical timer, and involves the parameter “pointer totimer id”; SCORE_EVENT_UNEXPECTED_INPUT which signals that theunexpected input data is available and involves the parameter “pointerto connection id”; SCORE_EVENT_TRIG_ON which signals that the userpulled the trigger and involves no parameters; SCORE_EVENT_TRIG_OFFwhich signals that the user released the trigger and involves noparameters; SCORE_EVENT_OBJECT_DETECT_ON which signals that the objectis positioned under the bar code reader and involves no parameters;SCORE_EVENT_OBJECT_DETECT_OFF which signals that the object is removedfrom the field of view of the bar code reader and involves noparameters; SCORE_EVENT_EXIT_TASK which signals the end of the taskexecution and involves the pointer UTID; and SCORE_EVENT_ABORT_TASKwhich signals the aborting of a task during execution.

The imaging-based bar code symbol reading device of the presentinvention provides the user with a command-line interface (CLI), whichcan work over the standard communication lines, such as RS232, availablein the bar code reader. The CLI is used mostly for diagnostic purposes,but can also be used for configuration purposes in addition to theMetroSet® and MetroSelect® programming functionalities. To send commandsto the bar code reader utilizing the CLI, a user must first enter theUser Command Manager by typing in a special character, which couldactually be a combination of multiple and simultaneous keystrokes, suchCtrl and S for example. Any standard and widely available softwarecommunication tool, such as Windows HyperTerminal, can be used tocommunicate with the bar code reader. The bar code reader acknowledgesthe readiness to accept commands by sending the prompt, such as “MTLG>”back to the user. The user can now type in any valid Applicationcommand. To quit the User Command Manager and return the scanner back toits normal operation, a user must enter another special character, whichcould actually be a combination of multiple and simultaneous keystrokes,such Ctrl and R for example.

An example of the valid command could be the “Save Image” command, whichis used to upload an image from the bar code reader's memory to the hostPC. This command has the following CLI format:

save [ filename [ compr ] ]

where

(1) save is the command name.

(2) filename is the name of the file the image gets saved in. Ifomitted, the default filename is “image.bmp”.

(3) compr is the compression number, from 0 to 10. If omitted, thedefault compression number is 0, meaning no compression. The highercompression number, the higher image compression ratio, the faster imagetransmission, but more distorted the image gets.

The imaging-based bar code symbol reader of the present invention canhave numerous commands. All commands are described in a single table(User Commands Table shown in FIG. 11) contained in the productApplications software layer. For each valid command, the appropriaterecord in the table contains the command name, a short description ofthe command, the command type, and the address of the function thatimplements the command.

When a user enters a command, the User Command Manager looks for thecommand in the table. If found, it executes the function the address ofwhich is provided in the record for the entered command. Upon returnfrom the function, the User Command Manager sends the prompt to the userindicating that the command has been completed and the User CommandManager is ready to accept a new command.

Specification of Software Modules within the Application Layer of theSystem Software Architecture Employed in Imaging-Based Bar Code Readerof the Present Invention

The image processing software employed within the system hereof performsits bar code reading function by locating and recognizing the bar codeswithin the frame of a captured image comprising pixel data. The modulardesign of the image processing software provides a rich set of imageprocessing functions, which could be utilized in the future for otherpotential applications, related or not related to bar code symbolreading, such as: optical character recognition (OCR) and verification(OCV); reading and verifying directly marked symbols on varioussurfaces; facial recognition and other biometrics identification; etc.

The CodeGate Task, in an infinite loop, performs the following task. Itilluminates a “thin” narrow horizontal area at the center of thefield-of-view (FOV) and acquires a digital image of that area. It thenattempts to read bar code symbols represented in the captured frame ofimage data using the image processing software facilities supported bythe Image-Processing Bar Code Symbol Reading Subsystem 17 of the presentinvention to be described in greater detail hereinafter. If a bar codesymbol is successfully read, then Subsystem 17 saves the decoded data inthe special Decode Data Buffer. Otherwise, it clears the Decode DataBuffer. Then, it continues the loop. The CodeGate Task routine neverexits on its own. It can be canceled by other modules in the system whenreacting to other events. For example, when a user pulls the triggerswitch 2C, the event TRIGGER_ON is posted to the application. TheApplication software responsible for processing this event, checks ifthe CodeGate Task is running, and if so, it cancels it and then startsthe Main Task. The CodeGate Task can also be canceled uponOBJECT_DETECT_OFF event, posted when the user moves the bar code readeraway from the object, or when the user moves the object away from thebar code reader. The CodeGate Task routine is enabled (with Main Task)when “semi-automatic-triggered” system modes of programmed operation(Modes of System Operation Nos. 11-14 in FIG. 26A) are to be implementedon the illumination and imaging platform of the present invention.

The Narrow-Area Illumination Task illustrated in FIG. 13M is a simpleroutine which is enabled (with Main Task) when “manually-triggered”system modes of programmed operation (Modes of System Operation Nos. 1-5in FIG. 26A) are to be implemented on the illumination and imagingplatform of the present invention. However, this routine is neverenabled simultaneously with CodeGate Task. As shown in the event flowchart of FIG. 13D, either CodeGate Task or Narrow-Area Illumination Taskare enabled with the Main Task routine to realize the diverse kinds ofsystem operation described herein.

Depending the System Mode in which the imaging-based bar code symbolreader is configured, Main Task will typically perform differently, butwithin the limits described in FIG. 13J. For example, when theimaging-based bar code symbol reader is configured in the ProgrammableMode of System Operation No. 12 (i.e. Semi-Automatic-TriggeredMultiple-Attempt 1 D/2 D Single-Read Mode) to be described in greaterdetail hereinafter, the Main Task first checks if the Decode Data Buffercontains data decoded by the CodeGate Task. If so, then it immediatelysends the data out to the user by executing the Data Output procedureand exits. Otherwise, in a loop, the Main Task does the following: itilluminates an entire area of the field-of-view and acquires afull-frame image of that area. It attempts to read a bar code symbol thecaptured image. If it successfully reads a bar code symbol, then itimmediately sends the data out to the user by executing the Data Outputprocedure and exits. Otherwise, it continues the loop. Notably, uponsuccessful read and prior to executing the Data Output procedure, theMain Task analyzes the decoded data for a “reader programming” commandor a sequence of commands. If necessary, it executes the MetroSelectfunctionality. The Main Task can be canceled by other modules within thesystem when reacting to other events. For example, the bar code readerof the present invention can be re-configured using standard Metrologicconfiguration methods, such as MetroSelec® and MetroSet®. TheMetroSelect functionality is executed during the Main Task.

The MetroSet functionality is executed by the special MetroSet Task.When the Focus RS232 software driver detects a special NULL-signal onitss communication lines, it posts the METROSET_ON event to theApplication. The Application software responsible for processing thisevent starts the MetroSet task. Once the MetroSet Task is completed, thescanner returns to its normal operation.

(Modes of System Operation Nos. 6-10 in FIG. 26A) can be readilyimplemented on the illumination and imaging platform of the presentinvention by making the following software system modifications: (1) anAuto-Read Task routine would be added to the system routine library(wherein Auto-Read Task could be an infinite loop routine where theprimary operations of CodeGate Task and Main Task are sequenced togetherto attempt first automatic narrow-area illumination and image captureand processing, followed by automatic wide-area illumination and imagecapture and processing, and repeating the wide-area operation in aninfinite loop, until the object is no longer detected within aparticular predetermined time period; and (2) modifying the query block“Is CodeGate Task or Narrow-Area Illumination Task Enabled?” in theObject_Detect_On event handling routine shown in FIG. 13D, to furtherask whether the “Auto-Read Task Routine is enabled”, and on the “Yes”control path, providing a block which starts “Auto-Read Task” and thenadvancing control to Return.

Operating System Layer Software Modules within the Application Layer ofthe System Software Architecture Employed in Imaging-Based Bar CodeReader of the Present Invention

The Devices Drivers software modules, which includes trigger drivers,provides a means for establishing a software connection with thehardware-based manually-actuated trigger switch 2C employed on theimaging-based device, an image acquisition driver for implementing imageacquisition functionality aboard the imaging-based device, and an IRdriver for implementing object detection functionality aboard theimaging-based device.

As shown in FIG. 12I, the Device Drive software modules include: triggerdrivers for establishing a software connection with the hardware-basedmanually-actuated trigger switch 2C employed on the imaging-based barcode symbol reader of the present invention; an image acquisition driverfor implementing image acquisition functionality aboard theimaging-based bar code symbol reader; and an IR driver for implementingobject detection functionality aboard the imaging-based bar code symbolreader.

Basic System Operations Supported by the Three-Tier SoftwareArchitecture of the Hand-Supportable Digital Imaging-Based Bar CodeReading Device of the Present Invention

In FIGS. 13A through 13L, the basic systems operations supported by thethree-tier software architecture of the digital imaging-based bar codesymbol reader of the present invention are schematically depicted.Notably, these basic operations represent functional modules (orbuilding blocks) with the system architecture of the present invention,which can be combined in various combinations to implement the numerousProgrammable Modes of System Operation listed in FIG. 23 and describedin detail below, using the image acquisition and processing platformdisclosed herein. For purposes of illustration, and the avoidance ofobfuscation of the present invention, these basic system operations willbe described below with reference to Programmable Mode of SystemOperation No. 12: Semi-Automatic-Triggered Multiple-Attempt 1 D/2 DSingle-Read Mode Employing The No-Finder Mode And The Manual OrAutomatic Modes Of the Multi-Mode Bar Code Reading Subsystem 17.

FIG. 13A shows the basic operations carried out within the System CoreLayer of the system when the user points the bar code reader towards abar code symbol on an object. Such operations include the by IR devicedrivers enabling automatic detection of the object within the field, andwaking up of the Input/Output Manager software module. As shown in FIG.13B, the Input/Output Manager then posts the SCORE_OBJECT_DETECT_ONevent to the Events Dispatcher software module in response to detectingan object. Then as shown in FIG. 13C, the Events Dispatcher softwaremodule passes the SCORE_OBJECT_DETECT_ON event to the Application Layer.

Upon receiving the SCORE_OBJECT_DETECT_ON event at the ApplicationLayer, the Application Events Manager executes an event handling routine(shown in FIG. 13D) which activates the narrow-area (linear)illumination array 27 (i.e. during narrow-area illumination and imagecapture modes), and then depending on whether the presentation mode hasbeen selected and whether CodeGate Task or Narrow-Area Illumination Modehas been enabled during system configuration, this even handling routineexecutes either Main Task described in FIG. 13J, CodeGate Task describedin FIG. 13E, or Narrow-Area Illumination Task described in 13M. As shownin the flow chart of FIG. 13D, the system event handling routine firstinvolves determining whether the Presentation Mode has been selected(i.e. enabled), then the event handling routine determines whether theCodeGate Task or Narrow-Area Illumination Routines have been enabled(with Main Task). If CodeGate Task has been enabled, then ApplicationLayer starts CodeGate Task. If the Narrow-Area Illumination Task hasbeen enabled, then the Application Layer starts the Narrow-AreaIllumination Task, as shown.

As shown in FIG. 13E, the Application Layer executes the CodeGate Taskby first activating the narrow-area image capture mode in the Multi-ModeImage Formation and Detection Subsystem 13 (i.e. by enabling a fewmiddle rows of pixels in the CMOS sensor array 22), and thenacquiring/capturing a narrow image at the center of the FOV of the BarCode Reader. CodeGate Task then performs image processing operations onthe captured narrow-area image using No-Finder Module which has beenenabled by the selected Programmable Mode of System Operation No. 12. Ifthe image processing method results in a successful read of a bar codesymbol, then the Codegate Task saves the decoded symbol character datain the Codegate Data Buffer; and if not, then the task clears theCodegate Data Buffer, and then returns to the main block of the Taskwhere image acquisition reoccurs.

As shown in FIG. 13F, when the user pulls the trigger switch 2C on thebar code reader while the Code Task is executing, the trigger switchdriver in the OS Layer automatically wakes up the Input/Output Managerat the System Core Layer. As shown in FIG. 13G, the Input/OutputManager, in response to being woken up by the trigger device driver,posts the SCORE_TRIGGER_ON event to the Events Dispatcher also in theSystem Core Layer. As shown in FIG. 13H, the Events Dispatcher thenpasses on the SCORE_TRIGGER_ON event to the Application Events Managerat the Application Layer. As shown in FIGS. 13I1 and 13I2, theApplication Events Manager responds to the SCORE_TRIGGER_ON event byinvoking a handling routine (Trigger On Event) within the Task Managerat the System Core Layer.

As shown the flow chart of FIGS. 13I1 and 13I2, the routine determineswhether the Presentation Mode (i.e. Programmed Mode of System OperationNo. 10) has been enabled, and if so, then the routine exits. If theroutine determines that the Presentation Mode (i.e. Programmed Mode ofSystem Operation No. 10) has not been enabled, then it determineswhether the CodeGate Task is running, and if it is running, then itfirst cancels the CodeGate Task and then deactivates the narrow-areaillumination array 27 associated with the Multi-Mode IlluminationSubsystem 14, and thereafter executes the Main Task. If however theroutine determines that the CodeGate Task is not running, then itdetermines whether Narrow-Area Illumination Task is running, and if itis not running, then Main Task is started. However, if Narrow-AreaIllumination Task is running, then the routine increases thenarrow-illumination beam to full power and acquires a narrow-area imageat the center of the field of view of the system, then attempts to readthe bar code in the captured narrow-area image. If the read attempt issuccessful, then the decoded (symbol character) data is saved in theDecode Data Buffer, the Narrow-Area Illumination Task is canceled, thenarrow-area illumination beam is stopped, and the routine starts theMain Task, as shown. If the read attempt is unsuccessful, then theroutine clears the Decode Data Buffer, the Narrow-Area Illumination Taskis canceled, the narrow-area illumination beam is stopped, and theroutine starts the Main Task, as shown.

As shown in FIG. 13M, the Narrow-Area Task routine is an infinite looproutine that simply keeps a narrow-area illumination beam produced anddirected at the center of the field of view of the system in a recursivemanner (e.g. typically at half or less power in comparison with thefull-power narrow-area illumination beam produced during the running ofCodeGate Task).

As shown in FIG. 13J, the first step performed in the Main Task by theApplication Layer is to determine whether CodeGate Data is currentlyavailable (i.e. stored in the Decode Data Buffer), and if such data isavailable, then the Main Task directly executes the Data OutputProcedure described in FIG. 13K. However, if the Main Task determinesthat no such data is currently available, then it starts the ReadTimeOut Timer, and then acquires a wide-area image of the detectedobject, within the time frame permitted by the Read Timeout Timer.Notably, this wide-area image acquisition process involves carrying outthe following operations, namely: (i) first activating the wide-areaillumination mode in the Multi-Mode Illumination Subsystem 14 and thewide-area capture mode in the CMOS image formation and detection module;(ii) determining whether the object resides in the near-field orfar-field portion of the FOV (through object range measurement by theIR-based Object Presence and Range Detection Subsystem 12); and (iii)then activating either the near or far field wide-area illuminationarray to illuminate either the object in either the near or far fieldportions of the FOV using either the near-field illumination array 28 orthe far-field illumination array 29 (or possibly both 28 and 29 inspecial programmed cases) at an intensity and duration determined by theautomatic light exposure measurement and control subsystem 15; while(iv) sensing the spatial intensity of light imaged onto the CMOS imagesensing array 22 in accordance with the Global Exposure Control Methodof the present invention, described in detail hereinabove. Then the MainTask performs image processing operations on the captured image usingeither the Manual, ROI-Specific or Automatic Modes of operation(although it is understood that other image-processing based readingmethods taught herein, such as Automatic or OmniScan (as well we othersuitable alternative decoding algorithms/processes not disclosedherein), can be used depending on which Programmed Mode of SystemOperation has been selected by the end user for the imaging-based barcode symbol reader of the present invention. Notably, in theillustrative embodiment shown in FIG. 13J, the time duration of eachimage acquisition/processing frame is set by the Start Read TimeoutTimer and Stop Read Timeout Timer blocks shown therein, and that withinthe Programmed Mode of System Operation No. 12, the Main Task willsupport repeated (i.e. multiple) attempts to read a single bar codesymbol so long as the trigger switch 2C is manually depressed by theoperator and a single bar code has not yet been read. Then uponsuccessfully reading a (single) bar code symbol, the Main Task will thenexecute the Data Output Procedure. Notably, in other Programmed Modes ofSystem Operation, in which a single attempt at reading a bar code symbolis enabled, the Main Task will be modified accordingly to support suchsystem behavior. In such a case, an alternatively named Main Task (e.g.Main Task No. 2) would be executed to enable the required systembehavior during run-time.

It should also be pointed out at this juncture, that it is possible toenable and utilize several of different kinds of symbol reading methodsduring the Main Task, and to apply particular reading methods based onthe computational results obtained while processing the narrow-areaimage during the CodeGate Task, and/or while preprocessing of thecaptured wide-area image during one of the image acquiring/processingframes or cycles running in the Main Task. The main point to be madehere is that the selection and application of image-processing based barcode reading methods will preferably occur through the selectiveactivation of the different modes available within the multi-modeimage-processing based bar code symbol reading Subsystem 17, in responseto information learned about the graphical intelligence representedwithin the structure of the captured image, and that such dynamic shouldoccur in accordance with principles of dynamic adaptive learningcommonly used in advanced image processing systems, speech understandingsystems, and alike. This general approach is in marked contrast with theapproaches used in prior art imaging-based bar code symbol readers,wherein permitted methods of bar code reading are pre-selected based onstatically defined modes selected by the end user, and not in responseto detected conditions discovered in captured images on a real-timebasis.

As shown in FIG. 13K, the first step carried out by the Data OutputProcedure, called in the Main Task, involves determining whether thesymbol character data generated by the Main Task is for programming thebar code reader or not. If the data is not for programming the bar codesymbol reader, then the Data Output Procedure sends the data outaccording to the bar code reader system configuration, and thengenerates the appropriate visual and audio indication to the operator,and then exits the procedure. If the data is for programming the barcode symbol reader, then the Data Output Procedure sets the appropriateelements of the bar code reader configuration (file) structure, and thensaves the Bar Code Reader Configuration Parameters in non-volatile RAM(i.e. NOVRAM). The Data Output Procedure then reconfigures the bar codesymbol reader and then generates the appropriate visual and audioindication to the operator, and then exits the procedure. As shown inFIG. 13L, decoded data is sent from the Input/Output Module at theSystem Core Layer to the Device Drivers within the Linux OS Layer of thesystem.

Wide-Area Illumination Control Method for Use During the Main TaskSystem Control Routine so as to Illuminate Objects with Wide-AreaIllumination in a Manner which Substantially Reduces Specular-TypeReflection at the CMOS Image Sensing Array of the Bar Code Symbol Reader

Referring to FIGS. 13N1 through 13N3, the method of illuminating objectswithout specular reflection, according to the present invention, willnow be described in detail. This control routine can be called duringthe acquisition of wide-area image step in the Main Task routine, shownin FIG. 13J.

As indicated at Step A in FIG. 13N1, the first step of the illuminationcontrol method involves using the Automatic Light Exposure MeasurementAnd Illumination Control Subsystem 15 to measure the ambient light levelto which the CMOS image sensing array 22 is exposed prior to commencingeach illumination and imaging cycle within the Bar Code Symbol ReadingSystem.

As indicated at Step B, the illumination control method involves usingthe Automatic IR-based Object Presence and Range Detection Subsystem 12to measure the presence and range of the object in either the near orfar field portion of the field of view (FOV) of the System.

As indicated at Step C, the illumination control method involves usingthe detected range and the measured light exposure level to drive boththe upper and lower LED illumination subarrays associated with eitherthe near-field wide-area illumination array 28 or far-field wide-areaillumination array 29.

As indicated at Step D, the illumination control method involvescapturing a wide-area image at the CMOS image sensing array 22 using theillumination field produced during Step C.

As indicated at Step E, the illumination control method involves rapidlyprocessing the captured wide-area image during Step D to detect theoccurrence of high spatial-intensity levels in the captured wide-areaimage, indicative of a specular reflection condition.

As indicated at Step F, the illumination control method involvesdetermining if a specular reflection condition is detected in theprocessed wide-area image, and if so then driving only the upper LEDillumination subarray associated with either the near-field or far-fieldwide-area illumination array. Also, if a specular reflection conditionis not detected in the processed wide-area image, then the detectedrange and the measured light exposure level is used to drive both theupper and lower LED subarrays associated with either the near-field orfar-field wide-area illumination array.

As indicated at Step G, the illumination control method involvescapturing a wide-area image at the CMOS image sensing array 22 using theillumination field produced during Step F.

As indicated at Step H, the illumination control method involves rapidlyprocessing the captured wide-area image during Step G to detect theoccurrence of high spatial-intensity levels in the captured wide-areaimage, indicative of a specular reflection condition.

As indicated at Step I, the illumination control method involvesdetermining if a specular reflection condition is still detected in theprocessed wide-area image, and if so, then drive the other LED subarrayassociated with either the near-field or far-field wide-areaillumination array. If a specular reflection condition is not detectedin the processed wide-area image, then the detected Range and themeasured Light Exposure Level is used to drive the same LED illuminationsubarray (as in Step C) associated with either the near-field wide-areaillumination array 28 or far field wide-area illumination array 29.

As indicated at Step J, the illumination control method involvescapturing a wide-area image at the CMOS image sensing array using theillumination field produced during Step I.

As indicated at Step K, the illumination control method involves rapidlyprocessing the captured wide-area image during Step J to detect theabsence of high spatial-intensity levels in the captured wide-areaimage, confirming the elimination of the earlier detected specularreflection condition.

As indicated at Step L, the illumination control method involvesdetermining if no specular reflection condition is detected in theprocessed wide-area image at Step K, and if not, then the wide-areaimage is processed using the mode(s) selected for the Multi-ModeImage-Processing Bar Code Reading Subsystem 17. If a specular reflectioncondition is still detected in the processed wide-area image, then thecontrol process returns to Step A repeats Steps A through K, asdescribed above.

Specification of Symbologies and Modes Supported by the Multi-Mode BarCode Symbol Reading Subsystem Module Employed within theHand-Supportable Digital Image-Based Bar Code Reading Device of thePresent Invention

FIG. 14 lists the various bar code symbologies supported by theMulti-Mode Bar Code Symbol Reading Subsystem 17 employed within thehand-supportable digital imaging-based bar code symbol reading device ofthe present invention. As shown therein, these bar code symbologiesinclude: Code 128; Code 39; 12 of 5; Code93; Codabar; UPC/EAN; Telepen;UK-Plessey; Trioptic; Matrix 2 of 5; Ariline 2 of 5; Straight 2 of 5;MSI-Plessey; Code11; and PDF417.

Specification of the Various Modes of Operation in the Multi-Mode BarCode Symbol Reading Subsystem of the Present Invention

As shown in FIG. 15, the Multi-Mode Image-Processing Based Bar CodeSymbol Reading Subsystem 17 of the illustrative embodiment supports fiveprimary modes of operation, namely: the Automatic Mode of Operation; theManual Mode of Operation; the ROI-Specific Mode of Operation; theNo-Finder Mode of Operation; and Omniscan Mode of Operation. As will bedescribed in greater detail herein, various combinations of these modesof operation can be used during the lifecycle of the image-processingbased bar code reading process of the present invention.

FIG. 16 is a exemplary flow chart representation showing the stepsinvolved in setting up and cleaning up the software sub-Applicationentitled “Multi-Mode Image-Processing Based Bar Code Symbol ReadingSubsystem 17”, once called from either (i) the CodeGate Task softwaremodule at the Block entitled READ BAR CODE(S) IN CAPTURED NARROW-AREAIMAGE indicated in FIG. 13E, or (ii) the Main Task software module atthe Block entitled “READ BAR CODE(S) IN CAPTURED WIDE-AREA IMAGE”indicated in FIG. 13J.

The Automatic Mode of Multi-Mode Bar Code Symbol Reading Subsystem

In its Automatic Mode of Operation, the Multi-Mode Bar Code SymbolReading Subsystem 17 is configured to automatically start processing acaptured frame of digital image data, prior to the complete bufferingthereof, so as to search for one or more bar codes represented thereinin an incremental manner, and to continue searching until the entireimage is processed.

This mode of image-based processing enables bar code locating andreading when no prior knowledge about the location of, or theorientation of, or the number of bar codes that may be present within animage, is available. In this mode of operation, the Multi-Mode Bar CodeSymbol Reading Subsystem 17 starts processing the image from thetop-left corner and continues until it reaches the bottom-right corner,reading any potential bar codes as it encounters them.

The Manual Mode of the Multi-Mode Bar Code Symbol Reading Subsystem

In its Manual Mode of Operation, the Multi-Mode Bar Code Symbol ReadingSubsystem 17 is configured to automatically process a captured frame ofdigital image data, starting from the center or sweep spot of the imageat which the user would have aimed the bar code reader, so as to searchfor (i.e. find) a at least one bar code symbol represented therein.Unlike the Automatic Mode, this is done by searching in a helical mannerthrough frames or blocks of extracted image feature data, and thenmarking the same and image-processing the corresponding raw digitalimage data until a bar code symbol is recognized/read within thecaptured frame of image data.

This mode of image processing enables bar code locating and reading whenthe maximum number of bar codes that could be present within the imageis known a priori and when portions of the primary bar code have a highprobability of spatial location close to the center of the image. TheMulti-Mode Bar Code Symbol Reading Subsystem 17 starts processing theimage from the center, along rectangular strips progressively furtherfrom the center and continues until either the entire image has beenprocessed or the programmed maximum number of bar codes has been read.

The ROI-Specific Mode of the Multi-Mode Bar Code Symbol ReadingSubsystem

In its ROI-Specific Mode of Operation, the Multi-Mode Bar Code SymbolReading Subsystem 17 is configured to automatically process a capturedframe of digital image data, starting from the region of interest (ROI)in the captured image, specified by coordinates acquired during aprevious mode of operation within the Multi-Mode Bar Code Symbol ReadingSubsystem 17. Unlike the Manual Mode, this is done by analyzing thereceived ROI-specified coordinates, derived during either a previousNoFinder Mode, Automatic Mode, or Omniscan Mode of operation, and thenimmediately begins processing image feature data, and image-processingthe corresponding raw digital image data until a bar code symbol isrecognized/read within the captured frame of image data. Thus,typically, the ROI-Specific Mode is used in conjunction with other modesof the Multi-Mode Bar Code Symbol Reading Subsystem 17.

This mode of image processing enables bar code locating and reading whenthe maximum number of bar codes that could be present within the imageis known a priori and when portions of the primary bar code have a highprobability of spatial location close to specified ROI in the image. TheMulti-Mode Bar Code Symbol Reading Subsystem starts processing the imagefrom these initially specified image coordinates, and then progressivelyfurther in a helical manner from the ROI-specified region, and continuesuntil either the entire image has been processed or the programmedmaximum number of bar codes have been read.

The No-Finder Mode of the Multi-Mode Bar Code Symbol Reading Subsystem

In its No-Finder Mode of Operation, the Multi-Mode Bar Code SymbolReading Subsystem 17 is configured to automatically process a capturednarrow-area (linear) frame of digital image data, without the featureextraction and marking operations used in the Automatic, Manual andROI-Specific Modes, so as to read a one or more bar code symbolsrepresented therein.

This mode enables bar code reading when it is known, a priori, that theimage contains at most one (1-dimensional) bar code symbol, portions ofwhich have a high likelihood of spatial location close to the center ofthe image and when the bar code is known to be oriented at zero degreesrelative to the horizontal axis. Notably, this is typically the casewhen the bar code reader is used in a hand-held mode of operation, wherethe bar code symbol reader is manually pointed at the bar code symbol tobe read. In this mode, the Multi-Mode Bar Code Symbol Reading Subsystem17 starts at the center of the image, skips all bar code location steps,and filters the image at zero (0) degrees and 180 degrees relative tothe horizontal axis. Using the “bar-and-space-count” data generated bythe filtration step, it reads the potential bar code symbol.

The Omni-Scan Mode of the Multi-Mode Bar Code Reading Subsystem

In its Omniscan Mode of Operation, the Multi-Mode Bar Code SymbolReading Subsystem 17 is configured to automatically process a capturedframe of digital image data along any one or more predetermined virtualscan line orientations, without feature extraction and markingoperations used in the Automatic, Manual and ROI-Specific Modes, so asto read a single bar code symbol represented in the processed image.

This mode enables bar code reading when it is known, a priori, that theimage contains at most one (1-dimensional) bar code, portions of whichhave a high likelihood of spatial location close to the center of theimage but which could be oriented in any direction. Multi-Mode Bar CodeSymbol Reading Subsystem 17 starts at the center of the image, skips allbar code location steps, and filters the image at different start-pixelpositions and at different scan-angles. Using the bar-and-space-countdata generated by the filtration step, the Omniscan Mode reads thepotential bar code symbol.

Specification of Multi-Mode Bar Code Symbol Reading Subsystem of thePresent Invention Operated During its Automatic Mode of Operation

As shown in FIG. 17A, the image-processing method carried out by theMulti-Mode Bar Code Symbol Reading Subsystem during its Automatic Modeof operation, comprises the following primary steps of operation,namely: (1) the first stage of processing involves searching for (i.e.finding) regions of interest (ROIs) by processing a low resolution imageof a captured frame of high-resolution image data, partitioning thelow-resolution image into N×N blocks, creating a feature vector (Fv) foreach block using spatial-derivative based image processing techniques,marking ROIs by examining the feature vectors for regions ofhigh-modulation, (2) the second stage of processing involves calculatingbar code orientation, and marking the four corners of a bar code as aROI, and (3) the third stage of processing involves reading any bar codesymbols represented within the ROI by traversing the bar code imagedata, updating the feature vectors, examining the zero-crossings offiltered image data, creating bar and space patterns, and decoding thebar and space patterns using conventional decoding algorithms.

As will be described hereinbelow, these three (3) stages of imageprocessing involved in the Automatic Mode of operation can besub-divided into four major processing blocks (i.e. modules), namely:the Tracker Module 100, the Finder Module 101, the Marker Module 102,and the Decoder Module 103, which are shown in FIG. 2A2 and described indetail below. When the Automatic Mode of the Multi-Mode Bar Code SymbolReading Subsystem 17 is invoked, these four processing blocks (i.e.modules) are executed, sequentially, and optionally incrementally sothat a rectangular sub-region of the entire image can be processed perinvocation.

First Stage of Image-Based Processing within the Multi-Mode Bar CodeSymbol Reading Subsystem During its Automatic Mode of Operation

During its Automatic Mode of operation, the first stage of processing inthe Multi-Mode Bar Code Symbol Reading Subsystem 17 comprises: (i)searching for (i.e. finding) regions of interest (ROIs) by processing alow resolution image of a captured frame of high-resolution image dataas shown in FIG. 18A; (ii) partitioning the low-resolution image of thepackage label into N×N blocks as shown in FIG. 18B; (iii) creating afeature vector for each block of low-resolution image data as shown inFIG. 18C using gradient vectors, edge density measures, the number ofparallel edge vectors, centroids of edge1s, intensity variance, and thehistogram of intensities captured from the low-resolution image; (iv)examining the feature vectors for regions for parallel lines bydetection of high modulation, high edge density, large number ofparallel edge vectors and large intensity variance (usingspatial-derivative based image processing techniques) as shown in FIG.18D; and (v) marking ROIs. In general, this stage of processing isstarted before all lines of the full digital image data frame arebuffered in memory, and typically only requires the number of rows in agiven (first) feature block to be buffered in memory before the readingprocess can begin.

Detailed Specification of the Tracker Module

As indicated at Blocks A, B, C, C1 and XX in FIG. 17B, the firstinvocation of the Tracker Module 100 resets the Finder Module 101,Marker Module 102, and Decoder Module 103 sub-components to theirinitial state (as Block A); it resets the feature vector array Fv (atBlock D) and the number of Regions of Interest (ROI). All subsequentinvocations set the maximum processing line number of each of the threeblocks to the current y-dimension of the image. The Tracker Moduleinvokes an optional callback function (Pause Checker) to facilitateaborting or pausing Multi-Mode Bar Code Symbol Reading Subsystem 17 orto change parameters on the fly.

Detailed Specification of the Finder Module

As indicated at Blocks D through Y in FIG. 17B, the Finder Module 101(processing block) sub-divides the image into N×N blocks, each of whichhas a feature vector array (Fv) element associated with it. An Fvelement contains a set of numbers that identify the strong possibilityof the presence of parallel lines within that image block. As indicatedat Blocks D through Y, the Finder Module 101 processes the image at alower spatial resolution; it processes every n^(th) line and everyn^(th) pixel within each of the selected lines thereby performingcalculations on the original image down-sampled-by-n. For each selectedline it calculates:

$\begin{matrix}{{\overset{\_}{I}}_{y} = \frac{n{\sum\limits_{x = 1}^{N_{x}}{I\left( {x,y} \right)}}}{N_{x}}} & (1)\end{matrix}$where I(x,y)=gray value at pixel location (x,y) and

N_(x)=x-dimension of the supplied (sub)image

If Ī_(y) exceeds a programmable “background threshold”, the image line yis declared a foreground line and is processed further by the FinderModule. A pixel is declared as a background pixel if its gray value isbelow a certain threshold. The Finder Module starts from the left-mostpixel and traverses right on the foreground line, finds at Block G thefirst pixel whose intensity (gray value) exceeds the programmablebackground threshold and marks it as the left-edge (x_(l)) of the line.At Block H, the Finder Module then starts from the right-most pixel andtraversing leftward on the foreground line determines the right-edge(x_(r)) using the same method. For foreground line y the Finder Modulecalculates at Block I:I ₁′(x,y)=|I(x+1,y)−I(x−1,y)|+|I(x,y+1)−I(x,y−1)|, whereX_(l)≦x≦X_(r)  (2)If I₁′(x,y) exceeds a threshold at Block J, the Finder Module markspixel (x,y) as an edge element or edge1.

In order to find the direction and magnitude of the edge-vectorcorresponding to edge1 (x,y), the Finder Module calculates at Block K:

$\begin{matrix}{{I_{0}^{\prime}\left( {x,y} \right)} = {\begin{matrix}\begin{matrix}{{w_{1}^{0}{I\left( {{x - 1},{y - 1}} \right)}} + {w_{2}^{0}{I\left( {x,{y - 1}} \right)}} + {w_{3}^{0}{I\left( {{x + 1},{y - 1}} \right)}} +} \\{{w_{4}^{0}{I\left( {{x - 1},y} \right)}} + {w_{5}^{0}{I\left( {x,y} \right)}} + {w_{6}^{0}{I\left( {{x + 1},y} \right)}} +}\end{matrix} \\{{w_{7}^{0}{I\left( {{x - 1},{y + 1}} \right)}} + {w_{8}^{0}{I\left( {x,{y + 1}} \right)}} + {w_{9}^{0}{I\left( {{x + 1},{y + 1}} \right)}}}\end{matrix}}} & (3) \\{{I_{45}^{\prime}\left( {x,y} \right)} = {\begin{matrix}\begin{matrix}\begin{matrix}{{w_{1}^{45}{I\left( {{x - 1},{y - 1}} \right)}} + {w_{2}^{45}{I\left( {x,{y - 1}} \right)}} +} \\{{w_{3}^{45}{I\left( {{x + 1},{y - 1}} \right)}} + {w_{4}^{45}{I\left( {{x - 1},y} \right)}} + {w_{5}^{45}{I\left( {x,y} \right)}} +}\end{matrix} \\{{w_{6}^{45}{I\left( {{x + 1},y} \right)}} + {w_{7}^{45}{I\left( {{x - 1},{y + 1}} \right)}} + {w_{8}^{45}{I\left( {x,{y + 1}} \right)}} +}\end{matrix} \\{w_{9}^{45}{I\left( {{x + 1},{y + 1}} \right)}}\end{matrix}}} & (4) \\{{I_{90}^{\prime}\left( {x,y} \right)} = {\begin{matrix}\begin{matrix}\begin{matrix}{{w_{1}^{90}{I\left( {{x - 1},{y - 1}} \right)}} + {w_{2}^{90}{I\left( {x,{y - 1}} \right)}} +} \\{{w_{3}^{90}{I\left( {{x + 1},{y - 1}} \right)}} + {w_{4}^{90}{I\left( {{x - 1},y} \right)}} + {w_{5}^{90}{I\left( {x,y} \right)}} +}\end{matrix} \\{{w_{6}^{90}{I\left( {{x + 1},y} \right)}} + {w_{7}^{90}{I\left( {{x - 1},{y + 1}} \right)}} + {w_{8}^{90}{I\left( {x,{y + 1}} \right)}} +}\end{matrix} \\{w_{9}^{90}{I\left( {{x + 1},{y + 1}} \right)}}\end{matrix}}} & (5) \\{{I_{135}^{\prime}\left( {x,y} \right)} = {\begin{matrix}\begin{matrix}\begin{matrix}{{w_{1}^{135}{I\left( {{x - 1},{y - 1}} \right)}} + {w_{2}^{135}{I\left( {x,{y - 1}} \right)}} +} \\{{w_{3}^{135}{I\left( {{x + 1},{y - 1}} \right)}} + {w_{4}^{135}{I\left( {{x - 1},y} \right)}} + {w_{5}^{135}{I\left( {x,y} \right)}} +}\end{matrix} \\{{w_{6}^{135}{I\left( {{x + 1},y} \right)}} + {w_{7}^{135}{I\left( {{x - 1},{y + 1}} \right)}} +}\end{matrix} \\{{w_{8}^{135}{I\left( {x,{y + 1}} \right)}} + {w_{9}^{135}{I\left( {{x + 1},{y + 1}} \right)}}}\end{matrix}}} & (6)\end{matrix}$where the coefficients w_(i) ⁰, w_(i) ⁴⁵, w_(i) ⁹⁰, w_(i) ¹³⁵ are givenby the operators:

$w^{0} = \begin{matrix}{- 1} & 0 & 1 \\{- 2} & 0 & 2 \\{- 1} & 0 & 1\end{matrix}$ $w^{45} = \begin{matrix}{- 2} & {- 1} & 0 \\{- 1} & 0 & 1 \\0 & 1 & 2\end{matrix}$ $w^{90} = \begin{matrix}{- 1} & {- 2} & {- 1} \\0 & 0 & 0 \\1 & 2 & 1\end{matrix}$ $w^{135} = \begin{matrix}0 & {- 1} & {- 2} \\1 & 0 & {- 1} \\2 & 1 & 0\end{matrix}$At Block M, the Finder Module updates the Fv block that edge1 (x,y)belongs to with: Edge strength:

$\begin{matrix}{{I^{\prime}{fv}_{i}} = {\sum\limits_{j = 1}^{n}I_{ij}^{\prime}}} & (7)\end{matrix}$

-   -   where I_(ij)=edge strength of edge1 j, and        -   n=number of edge1s inside Fv block i            Edge direction:

$\begin{matrix}{{{{A_{{fv}_{\; i}}(z)} = {\sum\limits_{j = 1}^{n}A_{j}}},{where}}{A_{j} = \left\{ {{{\begin{matrix}{1,} & {{j = k},} & {k \in \left\lbrack {0,3} \right\rbrack} \\{0\;} & \; & \;\end{matrix}I_{z_{1}}^{\prime}} \geq I_{z_{2}}^{\prime} \geq I_{z_{3}}^{\prime} \geq I_{z_{4}}^{\prime}},{z_{i} = {45*\left( {k + i - 1} \right)}}} \right.}} & (8)\end{matrix}$Centroid of edge1s:

$\begin{matrix}{{{\overset{\_}{x}}_{{fv}_{i}} = \frac{\sum\limits_{j = 1}^{n}x_{j}}{n}},{{\overset{\_}{y}}_{{fv}_{i}} = \frac{\sum\limits_{j = 1}^{n}y_{j}}{n}}} & (9)\end{matrix}$

-   -   where (x_(j),y_(j)) are the coordinates of the edge1s        Cumulative histogram:

$\begin{matrix}{{{{H_{{fv}_{i}}(z)} = {\sum\limits_{j = 1}^{n}H_{j}}},{where}}{H_{j} = \left\{ \begin{matrix}{1,} & {{I\left( {x,y} \right)} \leq z} \\0 & \;\end{matrix} \right.}} & (10)\end{matrix}$

At Block N, the Finder Module goes through all the lines of the currentimage section and populates the Fv array using the above-mentionedfeatures. At Blocks O through U, the Finder Module checks to see if alllines have been processed.

At Block V, the Finder Module then examines each Fv array element forfeatures that strongly point to the presence of parallel lines withinthe Fv block. At Block W, an interesting Fv is declared as part of aRegion of Interest (ROI) when the number of edge1s exceeds a threshold,at least one of the edge1 direction array elements exceeds a thresholdvalue, andm−n>C, whereH _(fv) _(i) (m)>αN,H _(fv) _(i) (n)>(1−α)N,C=Contrast−thresholdαε(0,1)N=total number of pixels in image block corresponding to feature vectorarray FvNotably, at Blocks C, E, and T, the Finder Module invokes the PauseChecker callback function to let the scanning application take control.Second Stage of Image-Based Processing within the Multi-Mode Bar CodeSymbol Reading Subsystem During its Automatic Mode of Operation

During its Automatic Mode of Operation, the second stage of processingin the Multi-Mode Bar Code Symbol Reading Subsystem 17 involves (ii)calculating bar code orientation by analyzing the feature vectors forparallel lines, and (ii) marking the four corners of a bar code as aROI, in terms of x.y coordinates.

FIGS. 18E and 18F illustrate calculating bar code orientation, duringthe second marking stage of processing within the Multi-Mode Bar CodeSymbol Reading Subsystem 17 during its Automatic Mode of operation,wherein within each feature vector block, the scan line datarepresenting the bar code is traversed (i.e. sliced) at differentangles, the slices are matched with each other based on “least meansquare error”, and the correct orientation is determined to be thatangle which matches the mean square error sense through every slice ofthe bar code.

FIG. 18G illustrates the marking of the four corners of the detected barcode symbol, during the second marking stage of processing within theMulti-Mode Bar Code Symbol Reading Subsystem 17 during its AutomaticMode of operation. During this stage of processing, such markingoperations are performed on the full high-resolution image of theparcel, the bar code is traversed in either direction starting from thecenter of the block, the extent of modulation is detected using theintensity variance, and the x,y coordinates (pixels) of the four cornersof the bar code are detected starting from 1 and 2 and movingperpendicular to the bar code orientation, so as to ultimately definethe ROI by the detected four corners of the bar code symbol within thehigh-resolution image.

Detailed Specification of the Marker Module

Within the Multi-Mode Bar Code Symbol Reading Subsystem 17 shown in FIG.2A2, the Marker Module as indicated at Blocks Z through KK, in FIG. 17B,takes over from the Finder Module and examines each ROI to determine thecomplete extent of the ROI. The Finder Module then checks the locationof the centroid of the ROI and compares it to the line number of theaccumulated images in memory.y _(roi) _(i) +L>N _(y)  (12)where y_(roi) _(i) =y coordinate of the centroid of ROI_(i)

L=Maximum length (in pixels) of any bar code presented to Multi-Mode BarCode Symbol Reading Subsystem

N_(y)=y-dimension of cumulative image

If inequality (12) holds, then the Marker Module postpones calculationsfor this ROI until the y-dimension of the image is such that inequalitydoes not hold. When the Marker Module continues to process the ROI, itfirst determines the orientation of the parallel lines that couldpotentially be part of a bar code, by calculating:

$\begin{matrix}{{{\theta = {\left( {225 - {\tan^{- 1}\left( \frac{I_{135}^{\prime}}{I_{45}^{\prime}} \right)}} \right){{mod}(180)}}},\mspace{45mu}{I_{0}^{\prime} \geq I_{45}^{\prime}},{I_{0}^{\prime} \geq I_{45}^{\prime}},{I_{0}^{\prime} \geq I_{135}^{\prime}}}{{\theta = {\left( {\tan^{- 1}\left( \frac{I_{90}^{\prime}}{I_{0}^{\prime}} \right)} \right){{mod}(180)}}},{I_{45}^{\prime} \geq I_{0}^{\prime}},{I_{45}^{\prime} \geq I_{90}^{\prime}},{I_{45}^{\prime} \geq I_{135}^{\prime}}}{{\theta = {\left( {45 + {\tan^{- 1}\left( \frac{I_{135}^{\prime}}{I_{45}^{\prime}} \right)}} \right){{mod}(180)}}},\mspace{45mu}{I_{90}^{\prime} \geq I_{45}^{\prime}},{I_{90}^{\prime} \geq I_{0}^{\prime}},{I_{90}^{\prime} \geq I_{135}^{\prime}}}{{\theta = {\left( {180 - {\tan^{- 1}\left( \frac{I_{90}^{\prime}}{I_{0}^{\prime}} \right)}} \right){{mod}(180)}}},\mspace{45mu}{I_{135}^{\prime} \geq I_{0}^{\prime}},{I_{135}^{\prime} \geq I_{90}^{\prime}},{I_{135}^{\prime} \geq I_{45}^{\prime}}}} & (13) \\{\begin{bmatrix}x_{j + 1} \\y_{j + 1}\end{bmatrix} = {\begin{bmatrix}x_{j} \\y_{j}\end{bmatrix} - \begin{bmatrix}{\cos\;\beta} \\{\sin\;\beta}\end{bmatrix}}} & (14) \\{\begin{bmatrix}x_{j}^{\prime} \\y_{j}^{\prime}\end{bmatrix} = {\begin{bmatrix}x_{j} \\y_{j}\end{bmatrix} - {n_{i}\begin{bmatrix}{{- \sin}\;\beta} \\{\cos\;\beta}\end{bmatrix}}}} & (15)\end{matrix}$

The angleθ that yields the minimum E(β), is assumed to be a closeapproximation of the actual orientation angle of the parallel lines.

Having calculated the correct orientation of the parallel lines, theMarker Module calculates the narrowest and the widest width of theparallel lines in the neighborhood of the ROI by traversing (i.e.scanning) the image in the direction of orientation of the lines as wellas at 180 degrees to it (e.g. using a spot size window of say N×N pixels(e.g. where 1<N<10). It should be noted that all angle measurements areclockwise relative to the horizontal axis. Equation (14) specifies thetraversal equation with β=θ,θ+180. Details of the method used tocalculate the widths of the lines are explained at length in the DecoderModule section.

The Marker Module uses the widths of the narrowest and widest elementsto determine a pixel count (n) that closely approximates the minimumquiet-zone allowable for any bar code symbology. It then traverses theimage again using equation (14) and calculates:

$\begin{matrix}{{m_{i} = \frac{\sum\limits_{j = i}^{i + n}{I\left( {x_{j},y_{j}} \right)}}{n}}{v_{i} = \frac{\sum\limits_{j = i}^{i + n}{{{I\left( {x_{j},y_{j}} \right)} - m_{i}}}}{n - 1}}{{IV}_{i} = \frac{v_{i}}{m_{i}^{2}}}} & (16)\end{matrix}$where m_(i)=mean of the set of n pixels starting at pixel i

v_(i)=variance of the set of n pixels starting at pixel I

If IV_(i) is less than a threshold, then the Marker Module makes theassumption that the group of parallel lines end at pixel i (similarlyfor the θ+180 direction). Starting from pixel i and traversing the imageusing (15) and a spot size window of say N×N pixels (e.g. where 1<N<10),and performing similar calculations as in equation (16) the four cornersthat approximate the quadrilateral bound of the potential bar code aredetermined. A pictorial representation of the above-mentioned method canbe found in the figure entitled “Step 6: Mark ROIs: Mark four corners ofbar code.

The Marker Module then marks all the Fv blocks that encompass thequadrilateral bound of the potential bar code, with the current ROIidentifier; if there already exists one or more ROIs with differentidentifiers, the Marker Module picks that ROI that completelyencompasses the others. The old ROIs are kept only if they are notcompletely enclosed within the current ROI.

The Marker Module also frequently invokes the Pause Checker to let thebar code reading Application (running) take over control.

Third Stage of Image-Based Processing within the Multi-Mode Bar CodeSymbol Reading Subsystem During its Automatic Mode of Operation

The third stage of processing involves reading any bar code symbolsrepresented within the ROI by traversing the bar code and updating thefeature vectors, examining the zero-crossings of filtered images,creating bar and space patterns, and decoding the bar and space patterns

FIG. 18H shows updating the feature vectors during the third stage ofprocessing within the Multi-Mode Bar Code Symbol Reading Subsystemduring its Automatic Mode of operation. During this stage of processing,the histogram component of the feature vector Fv is updated whiletraversing the bar code (using a spot size window of say N×N pixels(e.g. where 1<N<10), the estimate of the black-to-white transition iscalculated, and an estimate of narrow and wide elements of the bar codeare also calculated.

FIG. 18I illustrates the search for zero crossings during the thirdstage of processing within the Multi-Mode Bar Code Symbol ReadingSubsystem 17 during its Automatic Mode of operation. During this stageof processing, the high-resolution bar code image is median filtered ina direction perpendicular to bar code orientation, the second derivativezero crossings define edge crossings, the zero-crossing data is usedonly for detecting edge transitions, and the Black/White transitionestimates are used to put upper and lower bounds to bar and space greylevels, as graphically illustrated.

FIG. 18J illustrates creating a bar and space pattern during the thirdstage of processing within the Multi-Mode Bar Code Symbol ReadingSubsystem during its Automatic Mode of operation. During this stage ofprocessing, the edge transition is modeled as a ramp function, the edgetransition is assumed to be 1 pixel wide, the edge transition locationis determined at the subpixel level, and the bar and space counts aregathered using edge transition data;

FIG. 18K illustrates generating the decode bar and space pattern duringthe third stage of processing within the Multi-Mode Bar Code SymbolReading Subsystem during its Automatic Mode of operation. During thisstage of operation, the bar and space data is framed with borders, andthe bar and space data is decoded using existing laser scanning bar codedecoding algorithms.

Detailed Specification of the Decoder Module

As indicated in at Blocks LL through AAA in 17B, the Decoder Moduletakes over from the Marker Module and examines each ROI previouslydefined by the Marker Module. For each ROI, the Decoder Module uses thequadrilateral bound coordinates {x,y} to calculate the longer (higher)extremity of the potential bar code (towards the possible quiet-zones).The Decoder Module then computes the maximum number of possiblescan-lines as:

$\begin{matrix}{T = \frac{D}{n}} & (17)\end{matrix}$where D=length of the longer extremity, and n=pixel-offset perscan-line.

Notably, the parameter n (i.e. pixel-offset per scan line) representshow far the Decoder Module moves up its virtual scan direction (parallelto the previous virtual scan direction) and processes the image duringeach image processing cycle. As any captured image will be corrupted bysome degree of noise (and certainly greater levels when a bar codesymbol cannot be decoded), the Decoder Module needs to perform its nextprocessing cycle on a line of scan data that is located as far away aspossible from the previous line of scan data which did not result in asuccessful decode, but at the same time, the Decoder Module shouldexploit the inherent noise-immunity features provided in many bar codesymbologies. Thus, in accordance with the present invention, thepixel-offset per scan line variable n is not arbitrarily selected, as inmost prior art systems, but rather is determined by carefully (i)determining the maximum pixel height (length) of the ROI underconsideration, and (ii) dividing this maximum pixel height of the ROIinto a number of pixel-offset distances proportional to the maximumpixel height of the ROI. In the preferred embodiment, the number orsequence of scan lines into which the ROI can be divided for subsequentcycles of image processing, thus defining the pixel off-set perscan-line, is described by the formula: f(m,n)=(2m−1)/2^(n−1), wheren=1, 2 . . . N. and 1<m<2^(n-1).

The Decoder Module traverses the potential bar code using equation (14)and calculates approximations for the first and second orderderivatives:

$\begin{matrix}{{I_{i}^{\prime} = {\sum\limits_{j = {- 1}}^{1}\begin{bmatrix}\begin{matrix}\begin{matrix}\begin{matrix}{{w_{1}{I\left( {{x_{j} - 1},{y_{j} - 1}} \right)}} + {w_{2}{I\left( {x_{j},{y_{j} - 1}} \right)}} +} \\{{w_{3}{I\left( {{x_{j} + 1},{y_{j} - 1}} \right)}} + {w_{4}{I\left( {{x_{j} - 1},y_{j}} \right)}} +}\end{matrix} \\{{w_{5}{I\left( {x_{j},y_{j}} \right)}} + {w_{6}{I\left( {{x_{j} + 1},y_{j}} \right)}} +}\end{matrix} \\{{w_{7}{I\left( {{x_{j} - 1},{y_{j} + 1}} \right)}} + {w_{8}{I\left( {x_{j},{y_{j} + 1}} \right)}} +}\end{matrix} \\{w_{9}{I\left( {{x_{j} + 1},{y_{j} + 1}} \right)}}\end{bmatrix}}}{I_{i}^{''} = {I_{i + 1}^{\prime} - I_{i - 1}^{\prime}}}{where}} & (18) \\{{w_{i} = {{\begin{matrix}0.776 & 0.000 & {- 0.776} \\1.000 & 0.000 & {- 1.000} \\0.776 & 0.000 & {- 0.776}\end{matrix}\mspace{11mu}\ldots\mspace{11mu} 0} < \theta \leq 22}}{w_{i} = {{\begin{matrix}1.000 & 0.776 & 0.000 \\0.776 & 0.000 & {- 0.776} \\0.000 & {- 1.000} & {- 0.776}\end{matrix}\mspace{11mu}\ldots\mspace{11mu} 0} < \theta \leq 68}}{w_{i} = {{\begin{matrix}0.776 & 1.000 & 0.776 \\0.000 & 0.000 & 0.000 \\{- 0.776} & {- 1.000} & {- 0.776}\end{matrix}\mspace{11mu}\ldots\mspace{11mu} 0} < \theta \leq 113}}{w_{i} = {{\begin{matrix}0.000 & 0.776 & 1.000 \\{- 0.776} & 0.000 & 0.776 \\{- 1.000} & {- 0.776} & 0.000\end{matrix}\mspace{11mu}\ldots\mspace{11mu} 0} < \theta \leq 158}}} & (19) \\{w_{i} = {{\begin{matrix}{- 0.776} & 0.000 & 0.776 \\{- 1.000} & 0.000 & 1.000 \\{- 0.776} & 0.000 & 0.776\end{matrix}\mspace{11mu}\ldots\mspace{11mu} 158} < \theta \leq 180}} & \;\end{matrix}$and (x_(j),y_(j)) are related by equation (15).The Decoder Module examines the zero crossings of I_(i)″ and ifI _(i) ′·I _(i+1)′<0, andI _(i+1)″>0, andI_(i)′<−T  (20)where T=minimum derivative magnitude threshold, then the Decoder Moduleconcludes that a “space to bar transition” has occurred.If:I _(i) ″·I _(i+1)″<0, andI _(i+1)″<0, andI_(i)′>T  (21)then, the Decoder Module concludes that a “bar to space transition” hasoccurred.

The Decoder Module takes the difference in pixel position of adjacentbar/space transitions and adds it to the interpolated mid-point of thebar-space/space-bar transition (found using I_(i)″) to determine thewidth of each element of the potential bar code. This is the same methodused by the Marker Module to calculate the widths of the narrowest andwidest parallel lines.

Having calculated the “bar-and-space-count” data for each scan-line, theDecoder Module invokes the different (and separately enabled)symbology-decoders supported within the imaging-based bar code symbolreader, as indicated at FIG. 18K. Each symbology decoder, whether1-dimensional or certain 2-dimensional symbologies (like PDF417),detects the presence of the correct number of bars and spaces and alsothe correct start/stop pattern before attempting to decode the potentialbar code symbol.

If the Decoder Module decodes using the current “scan-line data”, thenit skips all other scan-lines. If the Decoder Module detects a stackedsymbology, then it continues to gather more scan-line-data. If decodingfails, then the Decoder Module adjusts the scan-line angles (barcode-orientation angle) progressively and repeats the process. TheDecoder Module, in the process of collecting scan-line-data, alsocorrelates the bar-and-space-data from one scan-line with that of theadjacent scan-lines in order to read through damaged or poorly presentedbar codes. For every bar code that is decoded by the Decoder Module, acallback function is invoked to save the decoded result. The DecoderModule calls the Pause Checker callback function frequently to let thescanning application take control.

In its Automatic Mode, the Multi-Mode Bar Code Symbol Reading Subsystem17 repeats this entire process for the entire image, and optionally forprogressively acquired images.

Specification of Multi-Mode Bar Code Symbol Reading Subsystem of thePresent Invention Operated During its Manual Mode of Operation

FIG. 19A illustrates the steps involved in the process carried out bythe Multi-Mode Bar Code Symbol Reading Subsystem during its Manual Modeof operation. During this manual mode of operation, the first stage ofprocessing involves searching for and finding regions of interest (ROIs)by processing a low resolution image of a captured frame ofhigh-resolution image data, partitioning the low-resolution image intoN×N blocks, and creating a feature vector for the middle block usingspatial-derivative based image processing techniques. Then, the secondstage of processing involves marking ROIs by examining the featurevectors for regions of high-modulation and returning to the first stageto create feature vectors for other blocks surrounding the middle block(in a helical manner), calculating bar code orientation and eventuallymarking the four corners of a bar code as a ROI, and (3) the third stageof processing involves reading any bar code symbols represented withinthe ROI by traversing the bar code and updating the feature vectors,examining the zero-crossings of filtered images, creating bar and spacepatterns, and decoding the bar and space patterns.

Like in the Automatic Mode, these three (3) stages of image processingin the manual mode of operation can be sub-divided into four majorprocessing blocks (i.e. modules), namely: the Tracker Module, the FinderModule, the Marker Module, and the Decoder Module, which have beendescribed in great detail above. When the Manual Mode of the Multi-ModeBar Code Symbol Reading Subsystem 17 is invoked, these four processingblocks (i.e. modules) are executed sequentially, and optionallyincrementally so that a rectangular sub-region of the entire image canbe processed per invocation.

FIG. 19B illustrates the steps involved in the decode process carriedout by the Multi-Mode Bar Code Symbol Reading Subsystem 17 during itsManual Mode of operation. As indicated at Block A, the Main Task orCodeGate Task in Application Layer invokes the Tracker Module to findthe center coordinates of the center block of captured image data, towhich the center feature vector will be associated. This central blockof image data will be associated with image pixels located along thecentral portion of the image frame captured by the imaging-based barcode symbol reader. This step involves the Tracker Module resetting theFinder Module, Marker Module, and Decoder Module sub-components to theirinitial state; it resets the feature vector array and the number ofRegions of Interest (ROI). While not indicated in the flow chart of FIG.19B, the Tracker Module invokes an optional callback function (PauseChecker) at various location within the control flow to facilitateaborting or pausing Multi-Mode Bar Code Symbol Reading Subsystem 17 orto change parameters on the fly.

As indicated at Block B in FIG. 19B, the Finder Module is invoked andthe captured image is subdivided into N×N blocks, each of which has afeature vector (Fv) array element associated with it. An Fv elementcontains a set of numbers that identify the strong possibility of thepresence of parallel lines within that image block. As describedhereinabove, the Finder Module processes the image at a lower spatialresolution; namely, it processes every n^(th) line and every n^(th)pixel within each of the selected lines thereby performing calculationson the original image down-sampled-by-n. For each selected line itcalculates. At Block C, the Subsystem 17 determines if an ROI (boundinga complete bar code symbol) is found, and if so, then invokes the MarkerModule. Then at Block E, the Subsystem 17 determines whether an ROI hasbeen marked by the Market Module, and if so, then the Decoder Module isinvoked and then the ROI processed. If a bar code symbol is read withinthe ROI at Block G, then at Block H the Subsystem 17 determines if theactual number of decode cycles equals the required number of decodecycles. If so, then the Manual Mode of operation of the Subsystem 17 isstopped, and the flow returns to the Application Layer.

If at Block C in FIG. 19B the Subsystem 17 determines that the ROI isnot found, then the subsystem proceeds to Block I. If the Subsystemdetermines that all feature vectors have not yet been examined, then theSubsystem proceeds to Block J which advances the analysis to the nextfeature vector closet to the center feature vector, along the locus of ahelical path through the image pixel data set. Then, at Block B, theSubsystem reinvokes the Finder Module to operate on this next featurevector.

If at Block G, the Subsystem determines that the Decoder Module does notsuccessfully decode a bar code symbol in the ROI, then it advances toBlock I and determines whether all feature vectors have not beenexamined.

The Subsystem 17 operated in the mode of operation specified by the flowchart of FIG. 19B until a single bar code symbol is read within an ROI.Each instance of the Finder Module involves the analysis of anotherblock of pixel data (corresponding to another feature vector) in effortto find an ROI containing a bar code symbol which can be found at BlockC and successfully decoded at Block G. The sequential analysis of blocksof pixel data follows a helical pattern about the center starting point,determined at Block A of FIG. 19B. Notably, during the Manual Mode ofOperation, the Subsystem utilizes the image processing techniquesdescribed in connection with the Automatic Mode of operation, above.

The primary advantage of the Manual Mode of operation over the AutomaticMode of operation is that the Manual Mode is that, when the user pointsthe bar code reader at a bar code symbol to be read, the bar code readerin the manual mode is more likely to acquire an image and process thepixel data within a ROI containing a bar code symbol is a very quickmanner, in comparison with the Automatic Mode which essentially scansand processes the entire captured image starting to from upper left mostblock of captured image data, ensuring a faster response time inhand-held bar code reading applications, in particular.

Specification of the Multi-Mode Bar Code Symbol Reading Subsystem of thePresent Invention Operated During its NoFinder Mode of Operation

FIG. 20A illustrates that the image processing carried out by theMulti-Mode Bar Code Symbol Reading Subsystem 17 during its NoFinder Modeof operation involves essentially a single stage of image processing,unlike the Automatic, Manual and ROI-Specific Modes of operation. Duringthis No-Finder Mode, Subsystem 17 does not employ the Tracker Module,the Finder Module or the Marker Module and instead only invokes theDecoder Module to (i) directly process the narrow-area high-resolutionimage captured by the bar code reader, one line of scan data at a time,starting from the middle thereof, (ii) examine the zero-crossings of thefiltered image, (iii) create bar and space patterns therefrom, and then(iv) decode the bar and space patterns using conventional decodingalgorithms. If the reading process is not successful, then the Subsystem17 traverses another line of scan data within the captured narrow-areaimage, starting from a pixel offset n which is computed assuming aconstant maximum height of the ROI which is deemed to be the pixelheight of the captured narrow-area image.

FIG. 20B illustrates the steps involved in the image processing methodcarried out by the Multi-Mode Bar Code Symbol Reading Subsystem 17during its NoFinder Mode of operation. As indicated at Block A in FIG.20B, the Subsystem 17 first finds (i.e. calculates) the center pixel inthe captured narrow-area image. Then at Block B, the Subsystem 17invokes the Decode Module and configures the same using the calculatedcenter pixel. Within the Decode Module, sub-Blocks B1 through B8 arethen carried out as shown in FIG. 20A. As indicated in Block B1, theDecoder Module, starting from the calculated center point, scans theimage horizontally and westward (using a spot-size window of say N×Npixels (e.g. where 1<N<10), and then processes the scanned image data todetermine if a first border in a bar code symbol is found. Notably, thisvirtual scanning process is realized as a mathematical convolution ofthe spot-size window and the pixel data in the image buffer. If a firstborder is found at Block B2, then, once again starting from thecalculated center point, the Decoder Module at Block B3 scans the imagehorizontally and eastward (using a spot size window of say N×N pixels(e.g. where 1<N<10), and then at Block B4 processes the scanned imagedata to determine if a second border in a bar code symbol is found. If asecond border is found at Block B4, then the Decoder Module processesthe captured image at Block B5. If, at Block B6, the Decoder Modulesuccessfully reads a bar code symbol within the scanned line of imagedata, then the Subsystem terminates the Decoder Module and stops theNoFinder Mode of operation.

If at Block B2 in FIG. 20A the Decoder Module does not find a firstborder of a bar code symbol, then it proceeds to Block B7 and determinesif it has tried all possible scan lines within the captured narrow-areaimage. If the Decoder Module has tried processing all possible scanlines through the narrow-area image, then it proceeds to the stop blockand terminates the NoFinder Mode of operation. If the Decoder Module hasnot tried processing all scan lines through the captured narrow-areaimage, then it proceeds to Block B8, where it advances to the next lineof scan data in the captured narrow-area image (i.e. by the offset pixelamount n), and then returns to Block B1 where scanning and processing isresumed along the new scan line (using a spot size window of say N×Npixels (e.g. where 1<N<10).

If at Block B4, the second bar code border is not found, then theDecoder Module proceeds to Block B7 and determines whether all scanlines through the captured image have been tried. If so, then theSubsystem 17 terminates the Decoder Module and exits its NoFinder Modeof operation. If all scan lines have not been tried at this stage of theprocess, then the Decoder Module proceeds to Block B8 and advances tothe next line of scan data for processing, as described hereinabove.

If at Block B6 in FIG. 20A the Decoder Module does not read a bar codewithin the current line of scan data being processed, then it proceedsto Block B7, where it determines if all lines of scan data have beentried. If all lines of scan data have not been tried, then at Block B8the Decoder Module advances to the next line of scan data in thecaptured narrow-area image (i.e. by the offset pixel amount n), and thenreturns to Block B1 where scanning and processing is resumed along thenew scan line (using a spot size window of say N×N pixels (e.g. where1<N<10). If at Block B7, the Decoder Module determines that all lines ofscan data have been tried, then the Decoder Module stops and terminatesits process. For every bar code that is decoded by the Decoder Module, acallback function is invoked to save the decoded result. The DecoderModule calls the Pause Checker callback function frequently to let thecar code symbol reading Application take control.

Specification of Multi-Mode Bar Code Symbol Reading Subsystem of thePresent Invention Operated During its OmniScan Mode of Operation

FIG. 21A illustrates that the image processing method carried out by theMulti-Mode Bar Code Symbol Reading Subsystem during its Omniscan Mode ofoperation involves essentially a single stage of image processing,unlike the Automatic, Manual and ROI-Specific Modes of operation. Duringthis Omniscan Mode, the Decoder Module does not employ the TrackerModule, the Finder Mode or the Marker Module and instead directlyprocesses the narrow-area high-resolution image captured by the bar codereader, along a plurality of spaced apart (e.g. 50 pixels) virtualscanning lines traversing through the entire 2 D frame of image datacaptured by the Subsystem 17. During the OmniScan Mode of operation, theDecoder Module assumes the imaged bar code symbol resides at the centerof the captured wide-area high-resolution image with about a 1:1 aspectratio (e.g. 1″ tall×1″ wide). Based on these assumptions, the Subsystem17 starts at first predetermined angular orientation (e.g. 0, 30, 60,90, 120 or 150 degrees), and then: (i) directly processes thehigh-resolution image along a set of parallel spaced-apart (e.g. 50pixels) virtual scan lines line (using a spot size window of say N×Npixels (e.g. where 1<N<10); (ii) examines the zero-crossings along thesevirtual scan lines; (iii) creates bar and space patterns therefrom; andthen (iv) decode processes the bar and space patterns. If imageprocessing along the selected angular orientation fails to read a barcode symbol, then the Subsystem 17 automatically reprocesses thehigh-resolution image along a different set of parallel spaced-apartvirtual scan lines oriented at a different angle from the previouslyprocessed set of virtual scan lines (e.g. 0, 30, 60, 90, 120 or 150degrees). This processing cycle continues until a single bar code symbolis read within the processed image.

FIG. 21B illustrates the steps involved in the image processing methodcarried out by the Multi-Mode Bar Code Symbol Subsystem 17 during itsOmniScan Mode of operation. As indicated at Block A in FIG. 21B, theSubsystem 17 first finds (i.e. calculates) the start pixel and scanangle in the captured narrow-area image. Then at Block B, the Subsystem17 invokes the Decode Module and configures the same using thecalculated (i) start pixel and (ii) start scan angle. Within the DecodeModule, sub-Blocks B1 through B8 are then carried out as shown in FIG.21B. As indicated at Block B1, the Decoder Module, starting from thecalculated start point and start angle, scans the image at the startangle and northwestwardly using a spot-size window of say N×N pixels(e.g. where 1<N<10), and then at Block B2 processes the scanned imagedata to determine if a first border in a bar code symbol is found.Notably, this virtual scanning process is realized as a mathematicalconvolution of the spot-size window and the pixel data in the imagebuffer. If a first border is found at Block B2, then, once againstarting from the calculated start point and start angle, the DecoderModule at Block B3 scans the image at the start angle andsouthwestwardly using a spot size window of say N×N pixels (e.g. where1<N<10), and then at Block B4 processes the scanned image data todetermine if a second border in a bar code symbol is found. If a secondborder is found at Block B4, then the Decoder Module invokes the DecoderModule described above at Block B5 and decode processes the scannedimage. If, at Block B6, the Decoder Module successfully reads a bar codesymbol within the scanned line of image data, then the Subsystem 17terminates the Decoder Module and stops the Omniscan Mode of operation.

If at Block B2 in FIG. 21A the Decoder Module does not find a firstborder of a bar code symbol, then it proceeds to Block B7 and determinesif it has tried all possible scan lines at combinations of start pixelsand start angles within the captured narrow-area image. If at Block B7the Decoder Module has tried processing all possible scan lines at startpixel and angle combinations through the narrow-area image, then itproceeds to the “stop” Block and terminates the Omniscan Mode of decoderoperation. If the Decoder Module has not tried processing all scan linesat all start pixel and angle orientations through the capturednarrow-area image, then it proceeds to Block B8, where it advances tothe next line of scan data in the captured narrow-area image (i.e. bythe offset pixel amount n), and then returns to Block B1 where scanningand processing is resumed along the new scan line (using a spot sizewindow of say N×N pixels (e.g. where 1<N<10).

If at Block B4, the second bar code border is not found, then theDecoder Module proceeds to Block B7 and determines whether all scanlines at all possible start pixels and angles (through the capturedimage) have been tried. If so, then the Decode Module terminates itsprocess and exits the Omnsican Mode of operation. If the scan lines atall start pixel and angle combinations have not been tried at this stageof the process, then the Decoder Module proceeds to Block B8 andadvances the next start pixel and angle for scan data image processing,and returns to Block B1 as described hereinabove.

If at Block G in FIG. 21A the Decoder Module does not decode a bar codewithin the current set of parallel lines of scan data being processed,then it proceeds to Block I, where it advances to the next set ofparallel scan lines (at a different set of start pixels and angle), andthen returns to Block B where scanning and processing is resumed alongthe new set of parallel scan lines (using a spot size window of say N×Npixels (e.g. where 1<N<10). For every bar code that is decoded by theDecoder Module, a callback function is invoked to save the decodedresult. The Decoder Module calls the Pause Checker callback functionfrequently to let the bar code reading Application take control.

Specification of Multi-Mode Bar Code Symbol Reading Subsystem of thePresent Invention Operated During its ROI-Specific Mode of Operation

FIG. 22A illustrates the steps involved in the image processing methodcarried out by the Multi-Mode Bar Code Symbol Reading Subsystem duringits ROI-Specific Mode of operation. Notably, the ROI-Specific Mode ofoperation is similar to the Manual Mode of operation, except that it isused to automatically process a specified “region of interest” (ROI)previously identified during the processing of a captured image frameduring a different mode of operation, e.g. the NoFinder Mode ofOperation or Omniscan Mode of Operation

As reflected in FIG. 22A, during this ROI-Specific Mode of operation,the first stage of processing involves receiving region of interest(ROI) coordinates {x,y} obtained during other modes of operation (e.g.Omniscan Mode, Automatic Mode or NoFinder Mode—after the occurrence of afailure to read), and re-partitioning the captured low-resolution image(from the Omniscan Mode) into N×N blocks, and instantiating a featurevector for the ROI-specified block(s) using features imported from andcollected during the Omniscan, Automatic or No-Finder Module (andpossibly utilizing additional spatial-derivative based image processingtechniques). The second stage of processing involves marking additionalROIs by examining the feature vectors for regions of high-modulation(about the originally specified ROI) and returning to the first stage tocreate feature vectors for other blocks surrounding the specified block(in a helical manner), calculating bar code orientation and marking thefour corners of a bar code contained within a ROI to be decodeprocessed. The third stage of processing involves reading any bar codesymbols represented within the ROI by traversing the pixel dataassociated with the bar code and updating the feature vectors, examiningthe zero-crossings of filtered images, creating bar and space patterns,and decoding the bar and space patterns using conventional bar codedecoding algorithms.

FIG. 22B illustrates the steps involved in the image processing methodcarried out by the Multi-Mode Bar Code Symbol Reading Subsystem duringits ROI-Specific Mode of operation. As indicated at Block A, the DecoderModule associated with either the Omniscan or NoFinder Mode receives{x.y} coordinates for a specific ROI (in which at least a portion of abar code symbol is likely to exist) to which an initial feature vectorwill be instantiated. Then at Block B, the Finder Mode is invoked, andat Block C, the Finder Module determines whether or not an ROI(containing a complete bar code symbol)) has been found. If the FinderModule determines that a ROI-contained bar code has been found, then theFinder Module invokes the Marker Module, whereupon at Block E, theMarker Module determines whether the ROI-contained bar code symbol hasbeen marked by the Marker Module. If so, then the Decoder Module isinvoked and then the high-resolution pixel data associated with the ROIis processed. If a bar code symbol is read within the ROI at Block G,then at Block H the Decoder Module determines if the actual number ofdecodes equals the required number of decode cycles (i.e. set by the enduser). If so, then the Manual Mode of Operation is stopped, and the flowreturns to the Application Layer.

If at Block C in FIG. 22B the Finder Module determines that an ROI(containing a complete bar code) is not found, then the Finder Moduleproceeds to Block I. If the Finder Mode determines that all featurevectors have not yet been examined, then the Finder Mode proceeds toBlock J which advances the analysis to the next feature vector closet tothe ROI-specified feature vector, along the locus of a helical paththrough the image pixel data set. Then, at Block B, the Finder Modulereinvokes itself to operate on this next feature vector.

If at Block G, the Decoder Module does not successfully read a bar codesymbol in the ROI, then it advances to Block I and determines whetherall feature vectors have not been examined. If so, then the DecoderModule terminates the ROI-specific Mode of operation. Typically, theSubsystem 17 continues in this mode of operation until, for example, asingle bar code symbol is read within an ROI marked as containing acomplete bar code symbol. Each instance of the Finder Module involvesthe analysis of another block of pixel data (corresponding to anotherfeature vector) in effort to find an ROI containing a complete bar codesymbol, which can be found at Block C and successfully read at Block G.The sequential analysis of blocks of pixel data follows a helicalpattern about the center starting point, determined at Block A of FIG.22B. Notably, during the Manual Mode of Operation, the Subsystemutilizes the image processing techniques described in connection withthe Automatic Mode of Operation, above.

Specification of Multi-Mode Bar Code Symbol Reading Subsystem of thePresent Invention Operated During its First Multi-Read(OmniScan/ROI-Specific) Mode of Operation

FIG. 23 describes the operation of the Multi-Mode Bar Code SymbolReading Subsystem 17 when it is driven into its first multi-read (e.g.Omniscan/ROI-Specific) mode of operation. In this first multi-read modeof operation, the Subsystem 17 adaptively processes and reads a capturedhigh-resolution image in a high-speed manner, applying adaptive learningtechniques, taught herein.

For example, assume the multi-mode image-processing symbol decodingsubsystem is configured to operate in its first multi-read(OmniScan/ROI-Specific) mode of operation, as shown in FIG. 23. In thiscase, if during the Omniscan Mode of operation, code fragmentsassociated with a PDF417 bar code symbol are detected within a ROI in acaptured (narrow or wide) area image, but processing thereof isunsuccessful, then the Multi-Mode Bar Code Symbol Reading Subsystem 17will automatically (i) enter its ROI-Specific Mode of operationdescribed above, and then (ii) immediately commences processing of thecaptured image at the ROI specified by ROI coordinates acquired byfeature vector analysis during the Omniscan Mode of operation. In theillustrative embodiment, this switching of modes in the Subsystem 17occurs within a single bar code symbol reading cycle, and involvesprocessing a captured image frame using at least two different modes(i.e. methods) of image-processing based bar code reading, within whichpotentially dozens of different bar code symbol decoding algorithms aretypically applied each decoding cycle.

One potential advantage of the Multi-Read (Omniscan/ROI-Specific) Modeof operation, over the Manual Mode of operation, is that the Multi-ReadMode offers an OmniScan Mode of operation to initially and rapidly read1 D bar code symbologies, and various kinds of 2 D bar code symbologieswhenever present in the captured image, and whenever a PDF417 symbologyis detected (through its code fragments), the Multi-Mode Bar Code SymbolReading Subsystem 17 can automatically switch (on-the-fly) to itsROI-specific Mode of operation to immediately process high-resolutionimage data at a specific ROI (at which there is a high likelihood of abar code symbol present).

Specification of Multi-Mode Bar Code Symbol Reading Subsystem of thePresent Invention Operated During its Second Multi-Read(No-Finder/ROI-Specific) Mode of Operation

FIG. 24 illustrates the Multi-Mode Bar Code Symbol Reading Subsystem 17when it is driven into its second multi-read (No-Finder/ROI-Specific)mode of operation so as to adaptively process and read a capturedhigh-resolution image, in a high-speed manner, by applying adaptivelearning techniques.

For example, assume the Multi-Mode Bar Code Symbol Reading Subsystem 17is configured to operate in its second multi-read(No-Finder/ROI-Specific) mode when processing a wide-area image capturedby the system, as shown in FIG. 24. In this case, if during the NoFinderMode of operation, code fragments associated with a PDF417 bar codesymbol are detected within the captured wide-area image, but processingthereof is unsuccessful, then the Subsystem 17 will automatically (i)enter its ROI-specific mode of operation described above, and then (ii)immediately commence processing of the captured wide-area image at a ROIspecified by y coordinates corresponding to the wide-area imageprocessed during the NoFinder Mode of operation. In the illustrativeembodiment, this switching of modes in the Image-Processing Bar CodeSymbol Reading Subsystem 17 occurs within a single bar code symbolreading cycle, and involves processing a single captured image frameusing at least two different modes (i.e. methods) of image-processingbased bar code reading (i.e. NoFinder Mode and ROI-Specific), withineach of which potentially dozens of different bar code symbol decodingalgorithms are typically applied during each decoding cycle.

Alternatively, assume the subsystem 17 is configured to operate in its“multi-read mode” when processing first a narrow-area image and then awide-area image captured by the system. In this case, if during theNoFinder Mode of operation, code fragments associated with a PDF417 barcode symbol are detected within the captured narrow-area image, butdecode processing thereof is unsuccessful, then the Subsystem 17 willautomatically (i) enter its ROI-specific mode of operation describedabove, as a wide-area image is automatically captured by the system, andthen (ii) immediately commence processing the captured wide-area imageat a ROI specified by y coordinates corresponding to the narrow-areaimage processed during the NoFinder Mode of operation. In theillustrative embodiment, this switching of modes in the Subsystem 17occurs within a single bar code symbol reading cycle, and involvesprocessing two captured image frames using at least two different modes(i.e. methods) of image-processing based bar code reading (i.e. NoFinderMode and ROI-Specific), within each of which potentially dozens ofdifferent bar code symbol decoding algorithms are typically appliedduring each decoding cycle.

One potential advantage of the “No-Finder/ROI-Specific” Multi-Modeoperation over the Manual Mode of operation, regardless of its method ofimplementation, is that the No-Finder Mode can rapidly read 1 D bar codesymbologies whenever they are presented to the bar code symbol reader,and then whenever a 2 D (e.g. PDF417) symbology is encountered, the barcode symbol reader can automatically switch its method of reading to theROI-specific Mode use features collected from a narrow (or wide) areaimage processed during the No-Finder Mode, so as to immediately processa specific ROI in a captured wide-area image frame, at which there is ahigh likelihood of a bar code symbol present, and to do so in a highlytargeted manner.

Specification of Multi-Mode Bar Code Symbol Reading Subsystem of thePresent Invention Operated During its Third Multi-Read(No-Finder/OmniScan/ROI-Specific) Mode of Operation

FIG. 25 illustrates the Multi-Mode Bar Code Symbol Reading Subsystem 17when it is driven into its third multi-read(No-Finder/OmniScan/ROI-Specific) mode of operation so as to adaptivelyprocess and read a captured high-resolution image, in a high-speedmanner, by applying adaptive learning techniques.

For example, assume the Subsystem 17 is configured to operate in its“multi-read mode” when processing a wide-area image captured by thesystem, as shown in FIG. 25. In this case, if during the NoFinder Modeof operation, code fragments associated with a PDF417 bar code symbolare detected within the captured narrow-area image, but decodeprocessing thereof is unsuccessful, then the Image Formation andDetection Subsystem (i) automatically captures a wide-area image, whilethe Subsystem 17 (ii) automatically enters its Omniscan Mode ofoperation described above, and then (iii) immediately commencesprocessing of the captured wide-area image at a plurality of parallelspatially-separated (e.g. by 50 pixels) virtual scan lines, beginning ata start pixel and start angle specified by x and/or y coordinates ofcode fragments detected in the narrow-area image processed during theNoFinder Mode of operation. Then, if the Omniscan Mode does notsuccessfully read a bar code symbol within the ROI, then the Subsystem17 (ii) automatically enters its ROI-specific mode of operationdescribed above, and then (iii) immediately commences processing of thecaptured wide-area image at a ROI specified by the x,y coordinatescorresponding to code fragments detected in the wide-area imageprocessed during the Omniscan Mode of operation. In the illustrativeembodiment, this switching of modes in the Subsystem 17 occurs within asingle bar code symbol reading cycle, and involves processing twocaptured image frames using at least three different modes (i.e.methods) of image-processing based bar code reading (i.e. NoFinder Mode,Omniscan Mode, and ROI-Specific Mode), within each of which potentiallydozens of different bar code symbol decoding algorithms are typicallyapplied during each decoding cycle.

One potential advantage of the “No-Finder/OmniScan/ROI-Specific”Multi-Read Mode operation over the Manual Mode of operation, regardlessof its method of implementation, is that the No-Finder Mode can rapidlyacquire 1 D bar code symbologies whenever they are presented to the barcode symbol reader, and then whenever a 2 D symbology is encountered,the bar code symbol reader can automatically switch its method ofreading to the OmniScan Mode, collected features on processed imagedata, and if this decoding method is not successful, then the bar codereader can automatically switch its method of reading to theROI-Specific Mode and use features collected during the Omniscan Mode toimmediately process a specific ROI in a captured image frame, at whichthere is a high likelihood of a bar code symbol present, and to do so ina highly targeted manner.

Programmable Modes of Bar Code Reading Operation within theHand-Supportable Digital Image-Based Bar Code Reading Device of thePresent Invention

As indicated in FIG. 26, the imaging-based bar code symbol reader of thepresent invention has at least seventeen (17) Programmable System Modesof Operation, namely: Programmed Mode of System Operation No.1—Manually-Triggered Single-Attempt 1 D Single-Read Mode Employing theNo-Finder Mode of the Multi-Mode Bar Code Reading Subsystem; ProgrammedMode Of System Operation No. 2—Manually-Triggered Multiple-Attempt 1 DSingle-Read Mode Employing the No-Finder Mode of the Multi-Mode Bar CodeReading Subsystem; Programmed Mode Of System Operation No.3—Manually-Triggered Single-Attempt 1 D/2 D Single-Read Mode Employingthe No-Finder Mode And The Automatic Or Manual Modes of the Multi-ModeBar Code Reading Subsystem; Programmed Mode of System Operation No.4—Manually-Triggered Multiple-Attempt 1 D/2 D Single-Read Mode Employingthe No-Finder Mode And The Automatic Or Manual Modes of the Multi-ModeBar Code Reading Subsystem; Programmed Mode of System Operation No.5—Manually-Triggered Multiple-Attempt 1 D/2 D Multiple-Read ModeEmploying the No-Finder Mode And The Automatic Or Manual Modes of theMulti-Mode Bar Code Reading Subsystem; Programmed Mode of SystemOperation No. 6—Automatically-Triggered Single-Attempt 1 D Single-ReadMode Employing The No-Finder Mode Of the Multi-Mode Bar Code ReadingSubsystem; Programmed Mode of System Operation No.7—Automatically-Triggered Multi-Attempt 1 D Single-Read Mode EmployingThe No-Finder Mode Of the Multi-Mode Bar Code Reading Subsystem;Programmed Mode of System Operation No. 8—Automatically-TriggeredMulti-Attempt 1 D/2 D Single-Read Mode Employing The No-Finder Mode andManual and/or Automatic Modes Of the Multi-Mode Bar Code ReadingSubsystem; Programmed Mode of System Operation No.9—Automatically-Triggered Multi-Attempt 1 D/2 D Multiple-Read ModeEmploying The No-Finder Mode and Manual and/or Automatic Modes Of theMulti-Mode Bar Code Reading Subsystem; Programmable Mode of SystemOperation No. 10—Automatically-Triggered Multiple-Attempt 1 D/2 DSingle-Read Mode Employing The Manual, Automatic or Omniscan Modes Ofthe Multi-Mode Bar Code Reading Subsystem; Programmed Mode of SystemOperation No. 11—Semi-Automatic-Triggered Single-Attempt 1 D/2 DSingle-Read Mode Employing The No-Finder Mode And The Automatic OrManual Modes Of the Multi-Mode Bar Code Reading Subsystem; ProgrammableMode of System Operation No. 12—Semi-Automatic-TriggeredMultiple-Attempt 1 D/2 D Single-Read Mode Employing The No-Finder ModeAnd The Automatic Or Manual Modes Of the Multi-Mode Bar Code ReadingSubsystem; Programmable Mode of Operation No.13—Semi-Automatic-Triggered Multiple-Attempt 1 D/2 D Multiple-Read ModeEmploying The No-Finder Mode And The Automatic Or Manual Modes Of theMulti-Mode Bar Code Reading Subsystem; Programmable Mode of OperationNo. 14—Semi-Automatic-Triggered Multiple-Attempt 1 D/2 D Multiple-ReadMode Employing The No-Finder Mode And The Omniscan Modes Of theMulti-Mode Bar Code Reading Subsystem; Programmable Mode of OperationNo. 15—Continously-Automatically-Triggered Multiple-Attempt 1 D/2 DMultiple-Read Mode Employing The Automatic, Manual Or Omniscan Modes Ofthe Multi-Mode Bar Code Reading Subsystem; Programmable Mode of SystemOperation No. 16—Diagnostic Mode Of Imaging-Based Bar Code ReaderOperation; and Programmable Mode of System Operation No. 17—Live VideoMode Of Imaging-Based Bar Code Reader Operation.

Preferably, these Modes Of System Operation can programmed by reading asequence of bar code symbols from a programming menu as taught, forexample, in U.S. Pat. No. 6,565,005, which describes a bar code scannerprogramming technology developed by Metrologic Instruments, Inc., andmarketed under the name MetroSelect® Single Line ConfigurationProgramming Method.

These Programmable System Modes of Operation will be described in detailhereinbelow. Alternatively, the MetroSet® Graphical User Interface (GUI)can be used to view and change configurationparameters in the bar codesymbol reader using a PC. Alternatively, a Command Line Interface (CLI)may also be used to view and change configuration parameters in the barcode symbol reader,

Each of these programmable modes of bar code reader operation shall benow described in greater detail with reference to other components ofthe system that are configured together to implement the same inaccordance with the principles of the present invention.

Overview of the Imaging-Based Bar Code Reader Start-Up Operations

When the bar code reader hereof boots up, its FPGA is programmedautomatically with 12.5/50/25 MHz clock firmware and all required devicedrivers are also installed automatically. The login to the OperatingSystem is also done automatically for the user “root”, and the user isautomatically directed to the /root/ directory. For nearly allprogrammable modes of system operation employing automatic objectdetection, the IR object detection software driver is installedautomatically. Also, for all Programmable System Modes of operationemploying the narrow-area illumination mode, the narrow-areaillumination software drivers are automatically installed, so that aPulse Width Modulator (PWM) is used to drive the narrow-area LED-basedillumination array 27. To start the bar code reader operation, theoperating system calls the /tmp/ directory first (“cd/tmp”), and thenthe focusapp program, located in /root/ directory is run, because the/root/ directory is located in Flash ROM, and to save captured images,the directory /tmp/ should be the current directory where the image isstored in transition to the host), which is located in RAM.

Operating the Hand-Supportable Image-Processing Bar Code Symbol Readerof the Present Invention in a Manually-Triggered Mode of Operation

The hand-supportable image-processing bar code symbol reader of thepresent invention can be programmed to operate in any one of a number ofdifferent “manually-triggered” modes of system operation, as identifiedin Nos. 1 through 5 in FIG. 26A. However, during each of thesemanually-triggered modes of operation, the image-processing bar codesymbol reader controls and coordinates its subsystem components inaccordance with a generalized method of manually-triggered operation.

In particular, upon automatic detection of an object within its IR-basedobject detection field, the IR-based object presence detection subsystemautomatically generates an object detection event, and in responsethereto, the multi-mode LED-based illumination subsystem automaticallyproduces a narrow-area field of narrow-band illumination within the FOVof said image formation and detection subsystem.

Then, upon the generation of the trigger event by the user depressingthe manually-actuatable trigger, the following operations areautomatically carried out:

(i) the image capturing and buffering subsystem automatically capturesand buffers a narrow-area digital image of the object using thenarrow-area field of narrow-band illumination within the FOV, during thenarrow-area image capture mode of said multi-mode image formation anddetection subsystem; and

(ii) the image processing bar code symbol reading subsystemautomatically processes said 1 D digital image attempts processes thenarrow-area digital image in effort to read a 1 D bar code symbolrepresented therein, and upon successfully decoding a 1 D bar codesymbol therein, automatically produces symbol character datarepresentative thereof.

Then, upon said multi-mode image processing bar code symbol readingsubsystem failing to successfully read the 1 D bar code symbolrepresented in the narrow-area digital image, the following operationsare automatically carried out:

(i) the multi-mode LED-based illumination subsystem automaticallyproduces a wide-area field of narrow-band illumination within the FOV ofthe multi-mode image formation and detection subsystem,

(ii) the image capturing and buffering subsystem captures and buffers awide-area digital image during the wide-area image capture mode of theimage capturing and buffering subsystem, and

(iii) the image processing bar code symbol reading subsystem processesthe wide-area digital image in effort to read a 1 D or 2 D bar codesymbol represented therein, and upon successfully decoding a 1 D or 2 Dbar code symbol therein, automatically produces symbol character datarepresentative thereof.

Programmed Mode of System Operation No. 1: Manually-TriggeredSingle-Attempt 1 D Single-Read Mode Employing the No-Finder Mode of theMulti-Mode Bar Code Symbol Reading Subsystem

Programmed Mode of System Operation No. 1 involves configuration of thesystem as follows: disabling the IR-based Object Presence and RangeDetection Subsystem 12; and enabling the use of manual-triggeractivation, the narrow-area illumination mode within the Multi-ModeIllumination Subsystem 14, the narrow-area image capture mode in theImage Formation and Detection Subsystem 13, and the No-Finder Mode ofthe Multi-Mode Bar Code Reading Subsystem 17.

During this mode of system operation, when a user pulls the triggerswitch 2C, the system activates the narrow-area illumination mode withinthe Multi-Mode Illumination Subsystem 14, the narrow-area image capturemode of the Image Formation and Detection Subsystem 13, and theNo-Finder Mode of the Multi-Mode Bar Code Symbol Reading Subsystem 17.Then, the bar code reader illuminates the target object usingnarrow-area illumination, captures a narrow-area image of the targetobject, and launches the No-Finder Mode of the Multi-Mode Bar CodeSymbol Reading Subsystem 17. The captured image is then processed usingthe No-Finder Mode. If a single cycle of programmed image processingresults in the successful reading of a 1 D bar code symbol, then theresulting symbol character data is sent to the Input/Output Subsystem 18for use by the host system. If single cycle of programmed imageprocessing is not result in a successful reading of a 1 D bar codesymbol, then the cycle is terminated, all subsystems are deactivated,and the bar code reader returns to its sleep mode of operation, and waitfor the next event (e.g. manually pulling trigger switch 2C) which willtrigger the system into active operation.

Programmed Mode of System Operation No. 2: Manually-TriggeredMultiple-Attempt 1 D Single-Read Mode Employing the No-Finder Mode ofthe Multi-Mode Bar Code Symbol Reading Subsystem

Programmed Mode of System Operation No. 2 involves configuration of thesystem as follows: disabling the IR-based Object Presence and RangeDetection Subsystem 12; and enabling the use of manual-triggeractivation, the narrow-area illumination mode within the Multi-ModeIllumination Subsystem 14, the narrow-area image capture mode in theImage Formation and Detection Subsystem 13, and the No-Finder Mode ofthe Multi-Mode Bar Code Symbol Reading Subsystem 17.

During this mode of system operation, when a user pulls the triggerswitch 2C, the system activates the narrow-area illumination mode withinthe Multi-Mode Illumination Subsystem 14, the narrow-area image capturemode of the Image Formation and Detection Subsystem 13, and theNo-Finder Mode of the Multi-Mode Bar Code Reading Subsystem 17. Then,the bar code reader illuminates the target object using narrow-areaillumination, captures a narrow-area image of the target object, andlaunches the No-Finder Mode of the Multi-Mode Bar Code Reading Subsystem17. The captured narrow-area image is then processed using the No-FinderMode. If the single cycle of programmed image processing results in thesuccessful reading of a 1 D bar code symbol, then the resulting symbolcharacter data is sent to the Input/Output Subsystem for use by the hostsystem. If the cycle of programmed image processing does not produce asuccessful read, then the system automatically enables successive cyclesof illumination/capture/processing so long as the trigger switch 2C isbeing pulled, and then until the system reads a bar code symbol within acaptured image of the target object; only thereafter, or when the userreleases the trigger switch 2C, will the bar code symbol reader returnto its sleep mode of operation, and wait for the next event that willtrigger the system into active operation. In the illustrativeembodiment, the default decode timeout is set to 500 ms which can besimply changed by programming. This default decode timeout settingensures that while the trigger switch 2C is being pulled by the user,the imaging-based bar code symbol reader will re-attempt reading every500 ms (at most) until it either succeeds or the trigger switch 2C ismanually released.

Programmed Mode of System Operation No. 3: Manually-TriggeredSingle-Attempt 1 D/2 D Single-Read Mode Employing the No-Finder Mode andthe Automatic, Manual or ROI-Specific Modes of the Multi-Mode Bar CodeSymbol Reading Subsystem

Programmed Mode of System Operation No. 3 involves configuration of thesystem as follows: disabling the IR-based Object Presence and RangeDetection Subsystem 12; and enabling the use of manual-triggeractivation, the narrow-area and wide-area illumination modes within theMulti-Mode Illumination Subsystem 14, the narrow-area and wide-areaimage capture modes in the Image Formation and Detection Subsystem 13,and the No-Finder Mode and Manual, ROI-Specific and/or Automatic Modesof the Multi-Mode Bar Code Reading Subsystem 17.

During this programmable mode of system operation, the bar code readeris idle (in its sleep mode) until a user points the bar code readertowards an object with a bar code label, and then pulls the triggerswitch 2C. When this event occurs, the system activates the narrow-areaillumination mode within the Multi-Mode Illumination Subsystem 14 (i.e.drives the narrow-area illumination array 27), the narrow-area imagecapture mode of the Image Formation and Detection Subsystem 13, and theNo-Finder Mode of the Multi-Mode Bar Code Reading Subsystem 17. Then,the bar code reader illuminates the target object using narrow-areaillumination, captures a narrow-area image of the target object, andlaunches the No-Finder Mode of the Multi-Mode Bar Code Reading Subsystem17. The captured narrow-area image is then processed using the No-FinderMode. If this single cycle of programmed image processing results in thesuccessful reading of a 1 D bar code symbol, then the resulting symbolcharacter data is sent to the Input/Output Subsystem 18 for use by thehost system. If this cycle of programmed image processing does notproduce a successful read, then the system deactivates the narrow-areaillumination mode within the Multi-Mode Illumination Subsystem 14, thenarrow-area image capture mode of the Image Formation and DetectionSubsystem 13, and the No-Finder Mode of the Multi-Mode Bar Code ReadingSubsystem 17, and then activates the wide-area illumination mode withinthe Multi-Mode Illumination Subsystem 14, the wide-area image capturemode of the Image Formation and Detection Subsystem 13, and the Manual,ROI-Specific and/or Automatic Modes of the Multi-Mode Bar Code ReadingSubsystem 17. Then the bar code reader illuminates the target objectusing both near-field and far-field wide-area illumination, captures awide-area image of the target object, and launches the Manual,ROI-Specific or Automatic Mode of the Multi-Mode Bar Code ReadingSubsystem 17. The captured wide-area image is then processed using theManual, ROI-Specific or Automatic Mode. If this single cycle ofprogrammed image processing results in the successful reading of a 1 Dor 2 D bar code symbol, then the resulting symbol character data is sentto the Input/Output Subsystem 18 for use by the host system. If thiscycle of programmed image processing does not produce a successful read,then the subsystem 19 deactivates all subsystems and then returns to itssleep mode, and waits for an event, which will cause it to re-enter itsactive mode of operation.

Programmed Mode of System Operation No. 4: Manually-TriggeredMultiple-Attempt 1 D/2 D Single-Read Mode Employing the No-Finder Modeand the Automatic Manual or ROI-Specific Modes of the Multi-Mode BarCode Symbol Reading Subsystem

Programmed Mode of System Operation No. 4 involves configuration of thesystem as follows: disabling the IR-based object detection subsystem 12;and enabling the use of manual-trigger activation, the narrow-area andwide-area illumination modes within the Multi-Mode IlluminationSubsystem 14, the narrow-area and wide-area image capture modes of theImage Formation and Detection Subsystem 13, and the No-Finder Mode andManual, ROI-Specific and/or Automatic Modes of the Multi-Mode Bar CodeReading Subsystem 17.

During this programmed mode of system operation, when a user pulls thetrigger switch 2C, the system activates the narrow-area illuminationmode within the Multi-Mode Illumination Subsystem 14, the narrow-areaimage capture mode of the Image Formation and Detection Subsystem 13,and the No-Finder Mode of the Multi-Mode Bar Code Reading Subsystem 17.Then, the bar code reader illuminates the target object usingnarrow-area illumination, captures a narrow-area image of the targetobject, and launches the No-Finder Mode of the Multi-Mode Bar CodeReading Subsystem 17. The captured narrow-area image is then processedusing the No-Finder Mode. If this single cycle of programmed imageprocessing results in the successful reading of a 1 D bar code symbol,then the resulting symbol character data is sent to the Input/OutputSubsystem for use by the host system. If this cycle of programmed imageprocessing does not produce a successful read, then the systemdeactivates the narrow-area illumination mode within the Multi-ModeIllumination Subsystem 14, the narrow-area image capture mode of theImage Formation and Detection Subsystem 13, and the No-Finder Mode ofthe Multi-Mode Bar Code Reading Subsystem 17, and then activates thewide-area illumination mode within the Multi-Mode Illumination Subsystem14, the wide-area image capture mode of the Image Formation andDetection Subsystem 13, and the Manual and/or Automatic Mode of theMulti-Mode Bar Code Reading Subsystem 17. Then, the bar code readerilluminates the target object using both near-field and far-fieldwide-area illumination, captures a wide-area image of the target object,and launches the Manual (or Automatic) Mode of the Multi-Mode Bar CodeReading Subsystem. The captured wide-area image is then processed usingthe Manual Mode of bar code symbol reading. If this single cycle ofprogrammed processing results in the successful reading of a 1 D or 2 Dbar code symbol, then the resulting symbol character data is sent to theInput/Output Subsystem 18 for use by the host system. If this cycle ofprogrammed image processing does not produce a successful read of asingle 1 D or 2 D bar code symbol, then the Subsystem 19 automaticallyenables successive cycles of wide-area illumination/wide-area imagecapture and processing so long as the trigger switch 2C is being pulled,and then until the system reads a single 1 D or 2 D bar code symbolwithin a captured image of the target object; only thereafter, or whenthe user releases the trigger switch 2C, will the bar code reader returnto its sleep mode of operation, and wait for the next event that willtrigger the system into active operation. In the illustrativeembodiment, the default decode timeout is set to 500 ms which can besimply changed by programming. This default decode timeout settingensures that while the trigger switch is being pulled by the user, theimaging-based bar code symbol reader will re-attempt reading every 500ms (at most) until it either succeeds or the trigger switch 2C ismanually released.

Programmed Mode of System Operation No. 5: Manually-TriggeredMultiple-Attempt 1 D/2 D Multiple-Read Mode Employing the No-Finder Modeand the Automatic, Manual or ROI-Specific Modes of the Multi-Mode BarCode Reading Symbol Subsystem

Programmed Mode of System Operation No. 5 involves configuration of thesystem as follows: disabling the IR-based Object Presence and RangeDetection Subsystem 12; and enabling the use of manual-triggeractivation, the narrow-area and wide-area illumination modes within theMulti-Mode Illumination Subsystem 14, the narrow-area and wide-areaimage capture modes of the Image Formation and Detection Subsystem 13,and the No-Finder Mode and Manual, ROI-Specific and/or Automatic Modesof the Multi-Mode Bar Code Reading Subsystem 17.

During this mode of system operation, when a user pulls the triggerswitch 2C, the system activates the narrow-area illumination mode withinthe Multi-Mode Illumination Subsystem 14, the narrow-area image capturemode of the Image Formation and Detection Subsystem 13, and theNo-Finder Mode of the Multi-Mode Bar Code Reading Subsystem. Then, thebar code reader illuminates the target object using narrow-areaillumination, captures a narrow-area image of the target object, andlaunches the No-Finder Mode of the Multi-Mode Bar Code ReadingSubsystem. The captured narrow-area image is then processed using theNo-Finder Mode. If this single cycle of programmed processing results inthe successful decoding of a 1 D bar code symbol, then the resultingsymbol character data is sent to the Input/Output Subsystem 18 for useby the host system. If this cycle of programmed decode image processingdoes not produce a successful read, then the system deactivates thenarrow-area illumination mode within the Multi-Mode IlluminationSubsystem 14, the narrow-area image capture mode of the Image Formationand Detection Subsystem 13, and the No-Finder Mode of the Multi-Mode BarCode Reading Subsystem 17, and then activates the wide-area illuminationmode within the Multi-Mode Illumination Subsystem, the wide-area imagecapture mode of the Image Formation and Detection Subsystem 13, and theManual and/or Automatic Mode of the Multi-Mode Bar Code ReadingSubsystem 17. Then, the bar code reader illuminates the target objectusing both near-field and far-field wide-area illumination, captures awide-area image of the target object, and launches the Manual(ROI-Specific and/or Automatic) Mode of the Multi-Mode Bar Code ReadingSubsystem 17. The captured wide-area image is then processed using theManual Mode of reading. If this single cycle of programmed processingresults in the successful reading of a 1 D or 2 D bar code symbol, thenthe resulting symbol character data is sent to the Input/OutputSubsystem 18 for use by the host system. If this cycle of programmedimage processing does not produce a successful reading of one or more 1D and/or 2 D bar code symbols, then the system automatically enablessuccessive cycles of wide-area illumination/wide-area imagecapture/image processing so long as the trigger switch is being pulled,and then until the system reads one or more 1 D and/or 2 D bar codesymbols within a captured image of the target object; only thereafter,or when the user releases the trigger switch 2C, will the bar codereader return to its sleep mode of operation, and wait for the nextevent that will trigger the system into active operation. In theillustrative embodiment, the default decode timeout is set to 500 mswhich can be simply changed by programming. This default decode timeoutsetting ensures that while the trigger switch 2C is being pulled by theuser, the imaging-based bar code symbol reader will re-attempt readingevery 500 ms (at most) until it either succeeds or the trigger switch 2Cis manually released.

Programmed Mode of System Operation No. 6: Automatically-TriggeredSingle-Attempt 1 D Single-Read Mode Employing the No-Finder Mode of theMulti-Mode Bar Code Symbol Reading Subsystem

Programmed Mode of System Operation No. 6 involves configuration of thesystem as follows: disabling the use of manual-trigger activation; andenabling IR-based Object Presence and Range Detection Subsystem 12, thenarrow-area illumination mode only within the Multi-Mode IlluminationSubsystem 14, the narrow-area image capture mode only in the ImageFormation and Detection Subsystem 13, and the No-Finder Mode of theMulti-Mode Bar Code Reading Subsystem 17.

During this programmed mode of system operation, the bar code reader isidle until a user points the reader towards an object with a bar codelabel. Once the object is under the field-of-view of the bar codereader, and the object is automatically detected, the bar code reader“wakes up” and the system activates the narrow-area illumination modewithin the Multi-Mode Illumination Subsystem 14, the narrow-area imagecapture mode of the Image Formation and Detection Subsystem 13, and theNo-Finder Mode of the Multi-Mode Bar Code Reading Subsystem 17. Thiscauses the system to illuminate a “narrow” horizontal area of the targetobject at the center of the field-of-view (FOV) of the bar code reader,indicating to the user where the area targeted by the bar code readeris, and thus, enabling the user to position and align the narrow-areaillumination beam on the target bar code. Then, the systemcaptures/acquires a narrow-area image, which is then processed using theBar Code Symbol Reading Subsystem 17 configured in its No-Finder Mode ofoperation. If this single cycle of programmed decode processing resultsin the successful reading of a 1 D bar code symbol, then the resultingsymbol character data is sent to the Input/Output Subsystem 18 for useby the host system. If this cycle of programmed image processing doesnot produce a successful read, then the system deactivates allsubsystems, causing the bar code reader return to its sleep mode ofoperation, and wait for the next event that will trigger the system intoactive operation.

Programmed Mode of System Operation No. 7: Automatically-TriggeredMulti-Attempt 1 D Single-Read Mode Employing the No-Finder Mode of theMulti-Mode Bar Code Symbol Reading Subsystem

Programmed Mode of System Operation No. 7 involves configuration of thesystem as follows: disabling the use of manual-trigger activation; andenabling IR-based Object Presence And Range Detection Subsystem 12, thenarrow-area illumination mode within the Multi-Mode IlluminationSubsystem 14, the narrow-area image capture mode in the Image Formationand Detection Subsystem 13, and the No-Finder Mode of the Multi-Mode BarCode Reading Subsystem 17.

During this programmed mode of system operation, the bar code reader isidle until a user points the bar code reader towards an object with abar code label. Once the object is under the field-of-view of the barcode reader, and the object is automatically detected, the bar codereader “wakes up” and the system activates the narrow-area illuminationmode within the Multi-Mode Illumination Subsystem 14, the narrow-areaimage capture mode of the Image Formation and Detection Subsystem 13,and the No-Finder Mode of the Multi-Mode Bar Code Reading Subsystem 17.This causes the system to illuminate a “narrow” horizontal area of thetarget object at the center of the field-of-view (FOV) of the bar codereader, indicating to the user where the area targeted by the bar codereader is, and thus, enabling the user to position and align thenarrow-area illumination beam on the target bar code. Then, the systemcaptures/acquires a narrow-area image, which is then processed using theNo-Finder Mode. If this single cycle of programmed image processingresults in the successful reading of a 1 D bar code symbol, then theresulting symbol character data is sent to the Input/Output Subsystem 18for use by the host system. If this cycle of programmed image processingdoes not produce a successful decode, then the system automaticallyenables successive cycles of narrow-area illumination/narrow-area imagecapture/processing so long as the trigger switch 2C is being pulled, andthen until the system reads a single 1 D bar code symbol within acaptured image of the target object; only thereafter, or when the userreleases the trigger switch 2C, will the bar code reader return to itssleep mode of operation, and wait for the next event that will triggerthe system into active operation. In the illustrative embodiment, thedefault decode timeout is set to 500 ms which can be simply changed byprogramming. This default decode timeout setting ensures that while thetrigger switch is being pulled by the user, the imaging-based bar codesymbol reader will re-attempt reading every 500 ms (at most) until iteither succeeds or the trigger switch 2C is manually released.

Programmed Mode of System Operation No. 8: Automatically-TriggeredMulti-Attempt 1 D/2 D Single-Read Mode Employing the No-Finder Mode andManual ROI-Specific and/or Automatic Modes of the Multi-Mode Bar CodeSymbol Reading Subsystem

Programmed Mode of System Operation No. 8 involves configuration of thesystem as follows: disabling the use of manual-trigger activation duringall phase of system operation; and enabling IR-based Object Presence andRange Detection Subsystem 12, the narrow-area illumination mode withinthe Multi-Mode Illumination Subsystem 14, the narrow-area image capturemode in the Image Formation and Detection Subsystem 13, and theNo-Finder Mode and Manual, ROI-Specific and/or Automatic Modes of theMulti-Mode Bar Code Reading Subsystem 17.

During this programmed mode of system operation, the bar code reader isidle until a user points the reader towards an object with a bar codelabel. Once the object is under the field-of-view of the scanner, andthe object is automatically detected, the bar code reader “wakes up” andthe system activates the narrow-area illumination mode within theMulti-Mode Illumination Subsystem, 14 the narrow-area image capture modeof the Image Formation and Detection Subsystem 13, and the No-FinderMode of the Multi-Mode Bar Code Reading Subsystem 17. This causes thesystem to illuminate a “narrow” horizontal area of the target object atthe center of the field-of-view (FOV) of the bar code reader, indicatingto the user where the area targeted by the bar code reader is, and thus,enabling the user to position and align the narrow-area illuminationbeam on the target bar code. Then, the system captures/acquires anarrow-area image, which is then processed using the No-Finder Mode ofoperation. If this single cycle of programmed image processing resultsin the successful reading of a 1 D bar code symbol, then the resultingsymbol character data is sent to the Input/Output Subsystem 18 for useby the host system. If this cycle of programmed image processing doesnot produce a successful read, then the system deactivates thenarrow-area illumination mode within the Multi-Mode IlluminationSubsystem 14, the narrow-area image capture mode of the Image Formationand Detection Subsystem 13, and the No-Finder Mode of the Multi-Mode BarCode Reading Subsystem 17, and then activates the wide-area illuminationmode within the Multi-Mode Illumination Subsystem 14, the wide-areaimage capture mode in the Image Formation and Detection Subsystem 13,and the Manual, ROI-Specific and/or Automatic Modes of the Multi-ModeBar Code Reading Subsystem 17. Then, the bar code symbol readerilluminates the target object using either near-field or far-fieldwide-area illumination (depending on the detected range of the targetobject), captures a wide-area image of the target object, and launchesthe Manual, ROI-Specific or Automatic Mode of the Multi-Mode Bar CodeReading Subsystem 17. The captured wide-area image is then processedusing the Manual Mode of reading. If this cycle of programmed imageprocessing results in the successful reading of a single 1 D or 2 D barcode symbol, then the resulting symbol character data is sent to theInput/Output Subsystem 18 for use by the host system. If this cycle ofprogrammed image processing does not produce a successful reading of asingle 1 D or 2 D bar code symbol, then the system automatically enablessuccessive cycles of wide-area illumination/wide-area imagecapture/processing so long as the target object is being detected, andthen until the system reads one or more 1 D and/or 2 D bar code symbolswithin a captured image of the target object; only thereafter, or whenthe user moves the object out of the FOV of the bar code reader, willthe bar code reader return to its sleep mode of operation, and wait forthe next event that will trigger the system into active operation. Inthe illustrative embodiment, the default decode timeout is set to 500 mswhich can be simply changed by programming. This default decode timeoutsetting ensures that while the object is being detected by the bar codereader, the bar code symbol reader will re-attempt reading every 500 ms(at most) until it either succeeds or the object is moved away from theFOV of the bar code reader.

Programmed Mode of System Operation No. 9: Automatically-TriggeredMulti-Attempt 1 D/2 D Multiple-Read Mode Employing the No-Finder Modeand Manual, ROI-Specific and/or Automatic Modes of the Multi-Mode BarCode Symbol Reading Subsystem

Programmed Mode of System Operation No. 9 involves configuration of thesystem as follows: disabling the use of manual-trigger activation duringall phases of system operation; and enabling IR-based Object Presenceand Range Detection Subsystem 12, the narrow-area illumination modewithin the Multi-Mode Illumination Subsystem 14, the narrow-area imagecapture mode in the Image Formation and Detection Subsystem 13, and theNo Finder Mode and Manual or Automatic Modes of the Multi-Mode Bar CodeSymbol Reading Subsystem 17.

During this programmed mode of system operation, the bar code reader isidle until a user points the reader towards an object with a bar codelabel. Once the object is under the field-of-view of the bar codereader, and the object is automatically detected, the bar code reader“wakes up” and the system activates the narrow-area illumination modewithin the Multi-Mode Illumination Subsystem 14, the narrow-area imagecapture mode of the Image Formation and Detection Subsystem 13, and theNo-Finder Mode of the Multi-Mode Bar Code Reading Subsystem 17. Thiscauses the system to illuminate a “narrow” horizontal area of the targetobject at the center of the field-of-view (FOV) of the bar code reader,indicating to the user where the area targeted by the bar code readeris, and thus, enabling the user to position and align the narrow-areaillumination beam on the target bar code. Then, the systemcaptures/acquires a narrow-area image, which is then processed using theNo-Finder Mode. If this single cycle of programmed processing results inthe successful reading of a 1 D bar code symbol, then the resultingsymbol character data is sent to the Input/Output Subsystem 18 for useby the host system. If this cycle of programmed image processing doesnot produce a successful read, then the system deactivates thenarrow-area illumination mode within the Multi-Mode IlluminationSubsystem 14, the narrow-area image capture mode of the Image Formationand Detection Subsystem 13, and the No-Finder Mode of the Multi-Mode BarCode Reading Subsystem 17, and then activates the wide-area illuminationmode within the Multi-Mode Illumination Subsystem 14, the wide-areaimage capture mode in the Image Formation and Detection Subsystem 13,and the Manual and/or Automatic Modes of the Multi-Mode Bar Code ReadingSubsystem 17. Then, the bar code reader illuminates the target objectusing either near-field or far-field wide-area illumination (dependingon the detected range of the target object), captures a wide-area imageof the target object, and launches the Manual (ROI-Specific orAutomatic) Mode of the Multi-Mode Bar Code Reading Subsystem 17. Thecaptured wide-area image is then processed using the Manual Method ofdecoding. If this cycle of programmed image processing results in thesuccessful reading of a single 1 D or 2 D bar code symbol, then theresulting symbol character data is sent to the Input/Output Subsystem 18for use by the host system. If this cycle of programmed image processingdoes not produce a successful read of a single 1 D or 2 D bar codesymbol, then the system automatically enables successive cycles ofwide-area-illumination/wide-area image-capture/processing so long as thetarget object is being detected, and then until the system reads one ormore 1 D and/or 2 D bar code symbols within a captured image of thetarget object; only thereafter, or when the user moves the object out ofthe FOV of the bar code symbol reader, will the bar code reader returnto its sleep mode of operation, and wait for the next event that willtrigger the system into active operation. In the illustrativeembodiment, the default decode timeout is set to 500 ms which can besimply changed by programming. This default decode timeout settingensures that while the object is being detected by the bar code reader,the bar code reader will re-attempt reading every 500 ms (at most) untilit either succeeds or the object is moved away from the FOV of the barcode reader.

Programmable Mode of System Operation No. 10: Automatically-TriggeredMultiple-Attempt 1 D/2 D Single-Read Mode Employing the Manual,ROI-Specific, Automatic or Omniscan Modes of the Multi-Mode Bar CodeSymbol Reading Subsystem

Programmed Mode of System Operation No. 10 involves configuration of thesystem as follows: disabling the use of manual-trigger activation duringall phase of system operation; and enabling IR-based Object Presence andRange Detection Subsystem 12, the narrow-area illumination mode withinthe Multi-Mode Illumination Subsystem 14, the narrow-area image capturemode in the Image Formation and Detection Subsystem 13, and the Manual,ROI-Specific, Automatic or OmniScan Modes of the Multi-Mode Bar CodeReading Subsystem 17.

During this programmed mode of system operation, the bar code reader isidle until a user present an object with a bar code symbol under thefield-of-view of the bar code reader, and the object is automaticallydetected, the bar code reader “wakes up” and the system activates thewide-area illumination mode within the Multi-Mode Illumination Subsystem14, the wide-area image capture mode in the Image Formation andDetection Subsystem 13, and either Manual, ROI-Specific, Automatic orOmniscan Mode of the Multi-Mode Bar Code Reading Subsystem 17. Thiscauses the system to illuminate a wide area of the target object withinthe field-of-view (FOV) of the bar code reader with far-field ornear-field wide area illumination (depending on the detected range ofthe target object), and capture/acquire a wide-area image which is thenprocessed using either the Manual, ROI-Specific, Automatic or OmniscanMethod of reading. If this single cycle of programmed processing resultsin the successful reading of a 1 D or 2 D bar code symbol (when theManual, ROI-Specific and Automatic Methods are used), then the resultingsymbol character data is sent to the Input/Output Subsystem for use bythe host system. If this cycle of programmed image processing does notproduce a successful read, then the system automatically enablessuccessive cycles of wide-areaillumination/wide-area-image-capture/processing so long as the targetobject is being detected, and then until the system reads a single 1 Dand/or 2 D bar code symbol within a captured image of the target object;only thereafter, or when the user moves the object out of the FOV of thebar code reader, will the bar code reader return to its sleep mode ofoperation, and wait for the next event that will trigger the system intoactive operation. In the illustrative embodiment, the default decodetimeout is set to 500 ms which can be simply changed by programming.This default decode timeout setting ensures that while the object isbeing detected by the bar code reader, the bar code reader willre-attempt reading every 500 ms (at most) until it either succeeds orthe object is moved away from the FOV of the bar code reader.

Programmed Mode of System Operation No. 11: Semi-Automatic-TriggeredSingle-Attempt 1 D/2 D Single-Read Mode Employing the No-Finder Mode andthe Automatic, ROI-Specific or Manual Modes of the Multi-Mode Bar CodeSymbol Reading Subsystem

Programmed Mode of System Operation No. 11 involves configuration of thesystem as follows: disabling the use of the manual-trigger activationduring the system activation phase of operation; and enabling theIR-based Object Presence and Range Detection Subsystem 12, thenarrow-area and wide-area illumination modes within the Multi-ModeIllumination Subsystem 14, the narrow-area and wide-area image capturemodes in the Image Formation and Detection Subsystem 13, and theNo-Finder Mode and Manual, ROI-Specific and/or Automatic Modes of theMulti-Mode Bar Code Reading Subsystem 17.

During this programmed mode of system operation, the bar code reader isidle until a user points the reader towards an object with a bar codelabel. Once the object is under the field-of-view of the bar codereader, and the object is automatically detected, the bar code reader“wakes up” and the system activates the narrow-area illumination modewithin the Multi-Mode Illumination Subsystem 14, the narrow-area imagecapture mode of the Image Formation and Detection Subsystem 13, and theNo-Finder Mode of the Multi-Mode Bar Code Reading Subsystem 17. Thiscauses the system to illuminate a “narrow” horizontal area of the targetobject at the center of the field-of-view (FOV) of the bar code reader,indicating to the user where the area targeted by the bar code readeris, and thus, enabling the user to position and align the narrow-areaillumination beam on the target bar code. Then, the systemcaptures/acquires a narrow-area image, which is then processed using theNo-Finder Mode. If this single cycle of programmed image processingresults in the successful reading of a 1 D bar code symbol, then theresulting symbol character data is sent to the Input/Output Subsystem 18for use by the host system. If this cycle of programmed image processingdoes not produce a successful read, then the system deactivates thenarrow-area illumination mode within the Multi-Mode IlluminationSubsystem 14, the narrow-area image capture mode of the Image Formationand Detection Subsystem 13, and the No-Finder Mode of the Multi-Mode BarCode Reading Subsystem 17, and then activates the wide-area illuminationmode within the Multi-Mode Illumination Subsystem 14, the wide-areaimage capture mode of the Image Formation and Detection Subsystem 13,and the Manual, ROI-Specific and/or Automatic Mode of the Multi-Mode BarCode Reading Subsystem 17. Then, if the user pulls the trigger switch 2Cduring narrow-area illumination and image capture and continues to doso, the bar code reader will automatically illuminate the target objectusing wide-area illumination, capture a wide-area image of the targetobject, and launch the Manual, ROI-Specific or Automatic Mode of theMulti-Mode Bar Code Symbol Reading Subsystem 17. The captured wide-areaimage is then processed using the Manual, ROI-Specific or AutomaticMode/Method of bar code reading. If this single cycle of programmedimage processing results in the successful reading of a single 1 D or 2D bar code symbol, then the resulting symbol character data is sent tothe Input/Output Subsystem 18 for use by the host system. If this cycleof programmed image processing does not produce a successful reading ofa single 1 D or 2 D bar code symbol, then the subsystem 19 automaticallydeactivates all subsystems, causing the bar code reader return to itssleep mode of operation, and wait for the next event that will triggerthe system into active operation

Programmable Mode of System Operation No. 12: Semi-Automatic-TriggeredMultiple-Attempt 1 D/2 D Single-Read Mode Employing the No-Finder Modeand the Automatic, ROI-Specific or Manual Modes of the Multi-Mode BarCode Symbol Reading Subsystem;

Programmed Mode of System Operation No. 12 involves configuration of thesystem as follows: disabling the use of manual-trigger activation duringthe system activation phase of operation; and enabling the IR-basedObject Presence and Range Detection Subsystem 12, the narrow-area andwide-area illumination modes within the Multi-Mode IlluminationSubsystem 14, the narrow-area and wide-area image capture modes in theImage Formation and Detection Subsystem 13, and the No-Finder Mode andManual, ROI-Specific and/or Automatic Modes of the Multi-Mode Bar CodeReading Subsystem 17.

During this programmed mode of system operation, the bar code reader isidle until a user points the reader towards an object with a bar codelabel. Once the object is under the field-of-view of the bar codereader, and the object is automatically detected, the bar code reader“wakes up” and the system activates the narrow-area illumination modewithin the Multi-Mode Illumination Subsystem 14, the narrow-area imagecapture mode of the Image Formation and Detection Subsystem 13, and theNo-Finder Mode of the Multi-Mode Bar Code Reading Subsystem 17. Thiscauses the system to illuminate a “narrow” horizontal area of the targetobject at the center of the field-of-view (FOV) of the bar code reader,indicating to the user where the area targeted by the bar code readeris, and thus, enabling the user to position and align the narrow-areaillumination beam on the target bar code. Then, the systemcaptures/acquires a narrow-area image, which is then processed using theNo-Finder Mode. If this single cycle of programmed image processingresults in the successful reading of a 1 D bar code symbol, then theresulting symbol character data is sent to the Input/Output Subsystem 18for use by the host system. If this cycle of programmed image processingdoes not produce a successful read, then the system deactivates thenarrow-area illumination mode within the Multi-Mode IlluminationSubsystem 14, the narrow-area image capture mode of the Image Formationand Detection Subsystem 13, and the No-Finder Mode of the Multi-Mode BarCode Reading Subsystem 17, and then activates the wide-area illuminationmode within the Multi-Mode Illumination Subsystem, the wide-area imagecapture mode of the Image Formation and Detection Subsystem 13, and theManual, ROI-Specific and/or Automatic Mode of the Multi-Mode Bar CodeReading Subsystem 17. Then, if the user pulls the trigger switch 2Cduring narrow-area illumination and image capture and continues to doso, the bar code reader will automatically illuminate the target objectusing wide-area illumination, capture a wide-area image of the targetobject, and launches the Manual, ROI-Specific or Automatic Mode of theMulti-Mode Bar Code Reading Subsystem 17. The captured wide-area imageis then processed using the Manual Mode of reading. If this single cycleof programmed image processing results in the successful reading of asingle 1 D or 2 D bar code symbol, then the resulting symbol characterdata is sent to the Input/Output Subsystem 18 for use by the hostsystem. If this cycle of programmed image processing does not produce asuccessful decode of a single 1 D or 2 D bar code symbol, then thesystem automatically enables successive cycles of wide-areaillumination/wide-area-image-capture/processing so long as the triggerswitch 2C is being pulled, and then until the system reads one or more 1D and/or 2 D bar code symbols within a captured image of the targetobject; only thereafter, or when the user releases the trigger switch2C, will the bar code reader return to its sleep mode of operation, andwait for the next event that will trigger the system into activeoperation. In the illustrative embodiment, the default decode timeout isset to 500 ms which can be simply changed by programming. This defaultdecode timeout setting ensures that while the trigger switch 2 c isbeing pulled by the user, the imaging-based bar code symbol reader willre-attempt reading every 500 ms (at most) until it either succeeds orthe trigger switch 2C is manually released.

Implementation of Programmable Mode of System Operation No. 12

When the Focus IR module detects an object in front of object detectionfield 20, it posts the OBJECT_DETECT_ON event to the Application Layer.The Application Layer software responsible for processing this eventstarts the CodeGate Task. When the user pulls the trigger switch 2C, theTRIGGER_ON event is posted to the Application. The Application Layersoftware responsible for processing this event checks if the CodeGateTask is running, and if so, it cancels it and then starts the Main Task.When the user releases the trigger switch 2C, the TRIGGER_OFF event isposted to the Application. The Application Layer software responsiblefor processing this event, checks if the Main Task is running, and ifso, it cancels it. If the object is still within the object detectionfield 20, the Application Layer starts the CodeGate Task again.

When the user moves the bar code reader away from the object (or theobject away from the bar code reader), the OBJECT_DETECT_OFF event isposted to the Application Layer. The Application Layer softwareresponsible for processing this event checks if the CodeGate Task isrunning, and if so, it cancels it. The CodeGate Task, in an infiniteloop, does the following. It activates the narrow-area illuminationarray 27 which illuminates a “narrow” horizontal area at the center ofthe field-of-view and then the Image Formation and Detection Subsystem13 acquires an image of that narrow-area (i.e. few rows of pixels on theCMOS image sensing array 22), and then attempts to read a bar codesymbol represented in the image. If the read is successful, it saves thedecoded data in the special CodeGate data buffer. Otherwise, it clearsthe CodeGate data buffer. Then, it continues the loop. The CodeGate Tasknever exits on its own; it can be canceled by other modules of the Focussoftware when reacting to other events.

When a user pulls the trigger switch 2C, the event TRIGGER_ON is postedto the Application Layer. The Application Layer software responsible forprocessing this event, checks if the CodeGate Task is running, and ifso, it cancels it and then starts the Main Task. The CodeGate Task canalso be canceled upon OBJECT_DETECT_OFF event, posted when the usermoves the bar code reader away from the object, or the object away fromthe bar code reader.

Programmable Mode of Operation No. 13: Semi-Automatic-TriggeredMultiple-Attempt 1 D/2 D Multiple-Read Mode Employing the No-Finder Modeand the Automatic, ROI-Specific or Manual Modes of the Multi-Mode BarCode Reading Subsystem

Programmed Mode of System Operation No. 13 involves configuration of thesystem as follows: disabling the use of manual-trigger activation duringthe system activation phase of operation; and enabling the IR-basedObject Presence and Range Detection Subsystem 12, the narrow-area andwide-area illumination modes within the Multi-Mode IlluminationSubsystem 14, the narrow-area and wide-area image capture modes in theImage Formation and Detection Subsystem 13, and the No-Finder Mode andManual, ROI-Specific and/or Automatic Modes of the Multi-Mode Bar CodeReading Subsystem 17.

During this programmed mode of system operation, the bar code reader isidle until a user points the reader towards an object with a bar codelabel. Once the object is under the field-of-view of the bar codereader, and the object is automatically detected by the Object Presenceand Range Detection Subsystem 12, the bar code reader “wakes up” and thesystem activates the narrow-area illumination mode in the Multi-ModeIllumination Subsystem 14, the narrow-area image capture mode in theImage Formation and Detection Subsystem 13, and the No-Finder Mode ofthe Multi-Mode Bar Code Reading Subsystem 17. This causes the system toilluminate a “narrow” horizontal area of the target object at the centerof the field-of-view (FOV) of the bar code reader, indicating to theuser where the area targeted by the bar code reader is, and thus,enabling the user to position and align the narrow-area illuminationbeam on the target bar code. Then, the system captures/acquires anarrow-area image which is then processed using the No-Finder Mode. Ifthis single cycle of programmed image processing results in thesuccessful reading of a 1 D bar code symbol, then the resulting symbolcharacter data is sent to the Input/Output Subsystem 18 for use by thehost system. If this cycle of programmed image processing does notproduce a successful read, then the system deactivates the narrow-areaillumination mode within the Multi-Mode Illumination Subsystem 14, thenarrow-area image capture mode of the Image Formation and DetectionSubsystem 13, and the No-Finder Mode of the Multi-Mode Bar Code ReadingSubsystem 17, and then activates the wide-area illumination mode withinthe Multi-Mode Illumination Subsystem 14, the wide-area image capturemode of the Image Formation and Detection Subsystem 13, and the Manualand/or Automatic Mode of the Multi-Mode Bar Code Reading Subsystem 17.Then, if the user pulls the trigger switch 2C during narrow-areaillumination and image capture and continues to do so, the bar codereader will automatically illuminate the target object using wide-areaillumination, capture a wide-area image of the target object, and invokethe Manual, ROI-Specific and/or Automatic Mode of the Multi-Mode BarCode Reading Subsystem 17. The captured wide-area image is thenprocessed using the Manual, ROI-Specific or Automatic Mode of reading.If this single cycle of programmed image processing results in thesuccessful reading of one or more 1 D and/or 2 D bar code symbols, thenthe resulting symbol character data is sent to the Input/OutputSubsystem 18 for use by the host system. If this cycle of programmeddecode image processing does not produce a successful reading of one ormore 1 D and/or 2 D bar code symbols then the system automaticallyenables successive cycles of wide-areaillumination/wide-area-image-capture/image-processing so long as thetrigger switch 2C is being pulled, and then until the system reads oneor more 1 D and/or 2 D bar code symbols within a captured image of thetarget object; only thereafter, or when the user releases the triggerswitch 2C, will the bar code reader return to its sleep mode ofoperation, and wait for the next event that will trigger the system intoactive operation. In the illustrative embodiment, the default decodetimeout is set to 500 ms which can be simply changed by programming.This default decode timeout setting ensures that while the triggerswitch 2C is being pulled by the user, the Imaging-Based Bar Code SymbolReader will re-attempt reading every 500 ms (at most) until it eithersucceeds or the trigger switch 2C is manually released.

Programmable Mode of Operation No. 14: Semi-Automatic-TriggeredMultiple-Attempt 1 D/2 D Multiple-Read Mode Employing the No-Finder Modeand the Omniscan Modes of the Multi-Mode Bar Code Symbol ReadingSubsystem

Programmed Mode of System Operation No. 14 involves configuration of thesystem as follows: disabling the use of manual-trigger activation duringthe system activation phase of operation; and enabling the IR-basedObject Presence and Range Detection Subsystem 12, the narrow-area andwide-area illumination modes within the Multi-Mode IlluminationSubsystem 14, the narrow-area and wide-area image capture modes in theImage Formation and Detection Subsystem 13, and the No-Finder Mode andOmniScan Mode of the Multi-Mode Bar Code Reading Subsystem 17.

During this programmed mode of system operation, the bar code reader isidle until a user points the reader towards an object with a bar codelabel. Once the object is under the field-of-view of the bar codereader, and the object is automatically detected by the Object Presenceand Range Detection Subsystem 12, the bar code reader “wakes up” and thesystem activates the narrow-area illumination mode in the Multi-ModeIllumination Subsystem 14, the narrow-area image capture mode in theImage Formation and Detection Subsystem 13, and the No-Finder Mode ofthe Multi-Mode Bar Code Reading Subsystem 17. This causes thenarrow-area illumination array 27 to illuminate a “narrow” horizontalarea of the target object at the center of the field-of-view (FOV) ofthe bar code reader, indicating to the user where the area targeted bythe bar code reader is, and thus, enabling the user to position andalign the narrow-area illumination beam on the target bar code. Then,Subsystem 13 captures/acquires a narrow-area image which is thenprocessed by Subsystem 17 using its No-Finder Mode. If this single cycleof programmed image processing results in the successful reading of a 1D bar code symbol, then the resulting symbol character data is sent tothe Input/Output Subsystem 18 for use by the host system, and then thesystem deactivates all subsystems and resumes its sleep state ofoperation. If this cycle of programmed image processing does not producea successful read, it may nevertheless produce one or more codefragments indicative of the symbology represented in the image, (e.g.PDF 417). In this case, the system deactivates the narrow-areaillumination mode within the Multi-Mode Illumination Subsystem 14, thenarrow-area image capture mode of the Image Formation and DetectionSubsystem 13, and the No-Finder Mode of the Multi-Mode Bar Code ReadingSubsystem 17; and then, if the user is pulling the trigger switch 2C atabout this time, the system activates the wide-area illumination modewithin the Multi-Mode Illumination Subsystem 14, the wide-area imagecapture mode of the Image Formation and Detection Subsystem, and eitherthe Omniscan Mode of the Multi-Mode Bar Code Reading Subsystem 17 ifcode fragments have been found indicating a 2 D code format (e.g. PDFformat code) within the image at perhaps a particular orientation. Then,the bar code reader proceeds to automatically illuminate the targetobject using wide-area illumination, capture a wide-area image of thetarget object, and invoke the Omniscan Mode of the Multi-Mode Bar CodeReading Subsystem 17. The captured wide-area image is then firstprocessed using the Omniscan Mode, using a first processing direction(e.g. at 0 degrees), and sequentially advances the Omniscan Mode ofreading at an different angular orientation (e.g. 6 possibledirections/orientations) until a single bar code symbol is successfullyread. If this single cycle of programmed decode processing (using theOmniscan Mode) results in the successful decoding of a single 1 D and/or2 D bar code symbol, then the resulting symbol character data is sent tothe Input/Output Subsystem 18 for use by the host system. If this cycleof programmed image processing does not produce a successful reading ofa single 1 D and/or 2 D bar code symbol, then the system automaticallyenables successive cycles of wide-area illumination/wide-area imagecapture/processing so long as the trigger switch 2C is being pulled, andthen until the system reads a single 1 D and/or 2 D bar code symbolwithin a captured image of the target object. Only thereafter, or whenthe user releases the trigger switch 2C, the system will return to itssleep mode of operation, and wait for the next event that will triggerthe system into active operation. In the illustrative embodiment, thedefault decode timeout is set to 500 ms which can be simply changed byprogramming. This default decode timeout setting ensures that while thetrigger switch 2C is being pulled by the user, the Imaging-Based BarCode Symbol Reader will re-attempt reading every 500 ms (at most) untilit either succeeds or the trigger switch is manually released.

Programmable Mode of Operation No. 15:Continuously-Automatically-Triggered Multiple-Attempt 1 D/2 DMultiple-Read Mode Employing the Automatic, Manual, ROI-Specific orOmniscan Modes of the Multi-Mode Bar Code Reading Subsystem

Programmed Mode of System Operation No. 15, typically used for testingpurposes, involves configuration of the system as follows: disabling theuse of manual-trigger activation during all phase of system operation;and enabling IR-based Object Presence and Range Detection Subsystem 12,the wide-area illumination mode in the Multi-Mode IlluminationSubsystem, 14 the wide-area image capture mode in the Image Formationand Detection Subsystem 13, and the Manual, ROI-Specific, Automatic orOmniScan Modes of the Multi-Mode Bar Code Reading Subsystem 17.

During this programmed mode of system operation, the bar code readercontinuously and sequentially illuminates a wide area of the targetobject within the field-of-view (FOV) of the bar code reader with bothfar-field and near-field wide-area illumination, captures a wide-areaimage thereof, and then processes the same using either the Manual,ROI-Specific, Automatic or Omniscan Modes of operation. If any cycle ofprogrammed image processing results in the successful reading of a 1 Dor 2 D bar code symbol (when the Manual, ROI-Specific and AutomaticModes are used), then the resulting symbol character data is sent to theInput/Output Subsystem 18 for use by the host system (i.e. typically atest measurement system). If when any cycle of programmed imageprocessing does not produce a successful read, the system automaticallyenables successive cycles of wide-area illumination/wide-areaimage-capture/processing. In the illustrative embodiment, the defaultdecode timeout is set to 500 ms which can be simply changed byprogramming. This default decode timeout setting ensures that while theobject is being detected by the bar code reader, the bar code readerwill re-attempt reading every 500 ms (at most) until it either succeedsor the object is moved away from the FOV of the bar code reader.

Diagnostic Mode of Imaging-Based Bar Code Reader Operation: ProgrammableMode of System Operation No. 16

Programmed Mode of System Operation No. 16 is a Diagnostic Mode. Anauthorized user can send a special command to the bar code reader tolaunch a Command Line Interface (CLI) with the bar code reader. When thebar code reader receives such request from the user, it sends a prompt“MTLG>” back to the user as a handshaking indication that the scanner isready to accept the user commands. The user then can enter any validcommand to the bar code reader and view the results of its execution. Tocommunicate with the reader in diagnostic mode over such communicationline as RS232, the user can use any standard communication program, suchas Windows HyperTerminal for example. This mode of operation can be usedto test/debug the newly introduced features or view/change the bar codereader configuration parameters. It can also be used to download imagesand/or a backlog of the previously decoded bar code data from the readermemory to the host computer.

Live Video Mode of Imaging-Based Bar Code Reader Operation: ProgrammableMode of System Operation No. 17

Program Mode of System Operation No. 17 can be used in combination withany other supported imaging modes. In this mode, the images acquired bythe bar code reader are transmitted to the host computer in real-timealong with the results of image-processing based bar code symbol readingby Subsystem 17 (if such results are available).

Second Illustrative Embodiment of Digital Imaging-Based Bar Code SymbolReading Device of the Present Invention, Wherein Four Distinct Modes ofIllumination are Provided

In the first illustrative embodiment described above, the Multi-modeIllumination Subsystem 14 had three primary modes of illumination: (1)narrow-area illumination mode; (2) near-field wide-area illuminationmode; and (3) far-field wide-area illumination mode.

In a second alternative embodiment of the digital imaging-based bar codesymbol reading device of the present invention shown in FIGS. 27A, 27Band 28, the Multi-Mode Illumination Subsystem 14 is modified to supportfour primary modes of illumination: (1) near-field narrow-areaillumination mode; (2) far-field narrow-area illumination mode; (3)near-field wide-area illumination mode; and (4) far-field wide-areaillumination mode. In general, these near-field and far-fieldnarrow-area illumination modes of operation are conducted during thenarrow-area image capture mode of the Multi-Mode Image Formation andDetection Subsystem 13, and are supported by a near-fieldnarrow-illumination array 27A and a far field narrow-area illuminationarray 27B illustrated in FIG. 28, and as shown in FIGS. 2A1. In thesecond illustrative embodiment, each of these illumination arrays 27A,27B are realized using at least a pair of LEDs, each having acylindrical lens of appropriate focal length to focus the resultingnarrow-area (i.e. linear) illumination beam into the near-field portion24A and far-field portion 24B of the field of view of the system,respectively.

One of advantages of using a pair of independent illumination arrays toproduce narrow-area illumination fields over near and far field portionsof the FOV is that it is possible to more tightly control the productionof a relatively “narrow” or “narrowly-tapered” narrow-area illuminationfield along its widthwise dimension. For example, as shown in FIG. 27B,during bar code menu reading applications, the near-field narrow areaillumination array 27A can be used to generate (over the near-fieldportion of the FOV) an illumination field 24A that is narrow along bothits widthwise and height-wise dimensions, to enable the user to easilyalign the illumination field (beam) with a single bar code symbol to beread from a bar code menu of one type or another, thereby avoidinginadvertent reads of two or more bar code symbols or simply the wrongbar code symbol. At the same time, the far-field narrow areaillumination array 27B can be used to generate (over the far-fieldportion of the FOV) an illumination field 24B that is sufficient widealong its widthwise dimension, to enable the user to easily readelongated bar code symbols in the far-field portion of the field of viewof the bar code reader, by simply moving the object towards the farportion of the field.

Third Illustrative Embodiment of Digital Imaging-Based Bar Code SymbolReading Device Of the Present Invention

Alternatively, the imaging-based bar code symbol reading device of thepresent invention can have virtually any type of form factor that wouldsupport the reading of bar code symbols at diverse applicationenvironments. One alternative form factor for the bar code symbolreading device of the present invention is shown in FIGS. 29A through29C, wherein a portable digital imaging-based bar code symbol readingdevice of the present invention 1″ is shown from various perspectiveviews, while arranged in a Presentation Mode (i.e. configured inProgrammed System Mode No. 12).

The Digital Imaging-Based Bar Code Reading Device of the PresentInvention

As shown in FIG. 30, the digital imaging-based bar code symbol readingdevice of the present invention 1′, 1″ can also be realized in the formof a Digital Imaging-Based Bar Code Reading Engine 100 that can bereadily integrated into various kinds of information collection andprocessing systems. Notably, trigger switch 2C shown in FIG. 30 issymbolically represented on the housing of the engine design, and it isunderstood that this trigger switch 2C or functionally equivalent devicewill be typically integrated with the housing of the resultant systeminto which the engine is embedded so that the user can interact with andactuate the same. Such Engines according to the present invention can berealized in various shapes and sizes and be embedded within variouskinds of systems and devices requiring diverse image capture andprocessing functions as taught herein.

Illustrative Embodiment of a Wireless Bar Code-Driven Portable DataTerminal (PDT) System of the Present Invention

FIGS. 31, 32 and 33 show a Wireless Bar Code-Driven Portable DataTerminal (PDT) System 140 according to the present invention whichcomprises: a Bar Code Driven PDT 150 embodying the Digital Imaging-BasedBar Code Symbol Reading Engine of the present invention 100, describedherein; and a cradle-providing Base Station 155.

As shown in FIGS. 31 and 32, the Digital Imaging-Based Bar Code SymbolReading Engine 100 can be used to read bar code symbols on packages andthe symbol character data representative of the read bar code can beautomatically transmitted to the cradle-providing Base Station 155 byway of an RF-enabled 2-way data communication link 170. At the sametime, robust data entry and display capabilities are provided on the PDT150 to support various information based transactions that can becarried out using System 140 in diverse retail, industrial, educationaland other environments.

As shown in FIG. 32, the Wireless Bar Code Driven Portable Data TerminalSystem 140 comprises: a hand-supportable housing 151; DigitalImaging-Based Bar Code Symbol Reading Engine 100 as shown in FIG. 30,and described herein above, mounted within the head portion of thehand-supportable housing 151; a user control console 151A; ahigh-resolution color LCD display panel 152 and drivers mounted belowthe user control console 151A and integrated with the hand-supportablehousing, for displaying, in a real-time manner, captured images, databeing entered into the system, and graphical user interfaces (GUIs)generated by the end-user application running on the virtual machine ofthe wireless PDT; and PDT computing subsystem 180 contained within thePDT housing, for carrying out system control operations according to therequirements of the end-user application to be implemented upon thehardware and software platforms of the wireless PDT 2B of thisillustrative embodiment.

As shown in block schematic diagram of FIG. 34, a design model for theWireless Hand-Supportable Bar Code Driven Portable Data Terminal System140 shown in FIGS. 31 and 32, and its cradle-supporting Base Station 155interfaced with possible host systems 173 and/or networks 174, comprisesa number of subsystems integrated about a system bus, namely: a datatransmission circuit 156 for realizing the PDT side of theelectromagnetic-based wireless 2-way data communication link 170;program memory (e.g. DRAM) 158; non-volatile memory (e.g. SRAM) 159;Digital Imaging-Based Bar Code Symbol Reading Engine 100 for opticallycapturing narrow and wide area images and reading bar code symbolsrecognized therein; a manual data entry device such as amembrane-switching type keypad 160; LCD panel 152; an LCD controller161; LCD backlight brightness control circuit 162; and a systemprocessor 163 integrated with a systems bus (e.g. data, address andcontrol buses). Also, a battery power supply circuit 164 is provided forsupplying regulated power supplies to the various subsystems, atparticular voltages determined by the technology used to implement thePDT device.

As shown in FIG. 34, the Base Station 155 also comprises a number ofintegrated subsystems, namely: a data receiver circuit 165 for realizingthe base side of the electromagnetic-based wireless 2-way datacommunication link 170; a data transmission subsystem 171 including acommunication control module; a base station controller 172 (e.g.programmed microcontroller) for controlling the operations of the BaseStation 155. As shown, the data transmission subsystem 171 interfaceswith the host system 173 or network 174 by way of the USB or RS232communication interfaces, TCP/IP, AppleTalk or the like, well known inthe art. Taken together, data transmission and reception circuits 156and 165 realize the wireless electromagnetic 2-way digital datacommunication link 170 employed by the wireless PDT of the presentinvention.

Notably, Wireless Hand-Supportable Bar Code Driven Portable DataTerminal System 140, as well as the POS Digital Imaging-Based Bar CodeSymbol Reader 1″ shown in FIGS. 29A through 29C, each have two primarymodes of operation: (1) a hands-on mode of operation, in which the PDT150 or POS Reader 1″ is removed from its cradle and used as a bar codedriven transaction terminal or simply bar code symbol reader; and (2) ahands-free mode of operation, in which the PDT 150 or POS Reader 1″remains in its cradle-providing Base Station 155, and is used apresentation type bar code symbol reader, as required in most retailpoint-of-sale (POS) environments. Such hands-on and hands-free modes ofsystem operation are described in greater detail in copending U.S.patent application Ser. No. 10/684,273 filed on Oct. 11, 2003, andincorporated herein by reference in its entirety.

In such hands-on and hands-free kinds of applications, the triggerswitch 2C employed in the digital imaging-based bar code symbol readingdevice of the present invention can be readily modified, and augmentedwith a suitable stand-detection mechanism, which is designed toautomatically configure and invoke the PDT 150 and its Engine 100 intoits Presentation Mode (i.e. System Mode of Operation No. 12) or othersuitable system mode when the PDT is placed in its Base Station 155 asshown in FIG. 33. Then when the PDT 150 is picked up and removed fromits cradling supporting Base Station 155 as shown in FIGS. 31 and 32,the trigger switch 2C and stand-detection mechanism, arrangement can bearranged so as to automatically configure and invoke the PDT 150 and itsEngine 100 into a suitable hands-on supporting mode of system operation(selected from the Table set forth in FIGS. 26A and 26B), to enablehands-on mode of operation.

Similarly, the trigger switch 2C employed in the POS Digital Imaging BarCode Symbol Reading Device 1″ can be readily modified, and augmentedwith stand-detection mechanism, which is designed to automaticallyconfigure and invoke the POS Reader 1″ into its Presentation Mode (i.e.System Mode of Operation No. 12) or other suitable system mode, when theReader 1″ is resting on a countertop surface, as shown in FIGS. 29A and29B. Then when the POS Reader 1″ is picked up off the countertopsurface, for use in its hands-on mode of operation, the trigger switch2C and stand-detection mechanism, arrangement will automaticallyconfigure and invoke Reader 1″ into a suitable hands-on supporting modeof system operation, as shown in FIG. 29C. In such embodiments, thestand-detection mechanism can employ a physical contact switch, or IRobject sensing switch, which is actuated then the device is picked upoff the countertop surface. Such mechanisms will become apparent in viewof the teachings disclosed herein.

Hand-Supportable Digital Imaging-Based Bar Code Symbol Reading DeviceEmploying Automatic Light Exposure Measurement and Illumination ControlSubsystem and a Software-Based Illumination Metering Program

In the system shown in FIGS. 1 through 34, automatic illuminationcontrol is provided by precise controlling the duration of LEDillumination during exposure, thereby capturing well-illuminated images.However, in some circumstances, greater degrees of illumination controlmay be required and the method shown in FIGS. 35 through 36 may behelpful.

In FIGS. 35 through 36, an enhanced auto-illumination control scheme isembodied within the hand-held image-processing bar code reader of thepresent invention. According to this alternative illumination controlscheme, the illumination level of a captured image is first (i.e.initially) determined by measuring the actual light illumination levelat a central portion of the image detection array, and then computing anappropriate illumination duration level based on this measurement. Then,after an image is captured using this initial illumination level, asoftware illumination metering program is used to analyze the spatialintensity distribution of the captured image and determine if a newillumination duration should be calculated for use in subsequent imageillumination and capture operations, to provide more fine-tuned images.If the light/illumination level represented in a captured digital imageis determined to be acceptable by the software-based illuminationmetering program, then the program automatically (i) calculates acorrected illumination duration (count) for use by the Automatic LightExposure Measurement and Illumination Control Subsystem, and (ii)provides the corrected illumination duration thereto. Then the AutomaticLight Exposure Measurement and Illumination Control Subsystem uses thiscorrected illumination duration to control the illumination delivered tothe field of view (FOV) during the next object illumination and imagecapturing operation supported by the system. By using this enhancedauto-illumination control method, the image-processing based bar codesymbol reader of the present invention is provided additionalflexibility in its ability to capture fine-tuned images in real-timehaving the optimal illumination levels.

FIG. 35 schematically illustrates the hand-supportable digitalimaging-based bar code symbol reading device of the present invention,wherein a Software-Based Illumination Metering Program is used to helpthe Automatic Light Exposure Measurement and Illumination ControlSubsystem control the operation of the LED-Based Multi-Mode IlluminationSubsystem. FIG. 35A illustrates in greater detail this enhanced methodof automatic illumination control, namely how the current illuminationduration (determined by the Automatic Light Exposure Measurement andIllumination Control Subsystem) is automatically over-written by theillumination duration computed by a software-implemented,image-processing-based Illumination Metering Program carried out withinthe Image-Processing Based Bar Code Symbol Reading Subsystem. Thisover-written illumination duration is then used by the Automatic LightExposure Measurement and Illumination Control Subsystem to control theamount of LED illumination produced and delivered to the CMOS imagedetection array during the next image frame captured by the system, inaccordance with this Enhanced Auto-Illumination Control Scheme of thepresent invention.

FIG. 36 is a flow chart setting forth the steps involved in carrying outthe enhanced auto-illumination control scheme/method illustrated in FIG.35A. As indicated at Block in FIG. 36, the first step of the methodinvolves using the Automatic Light Exposure Measurement and IlluminationControl Subsystem to automatically (i) measure the illumination level ata particular (e.g. central) portion of field of view of the CMOS imagesensing array and (ii) determine the illumination duration (i.e. timecount) necessary to achieve a desired spatial intensity in the capturedimage.

As indicated at Block B in FIG. 36, the Automatic Light ExposureMeasurement and Illumination Control Subsystem uses thiscomputed/determined illumination duration to drive the LED-basedillumination subsystem and capture a digital image of the object withinthe field of view of the Image Formation and Detection Subsystem.

As indicated at Block C in FIG. 36, the Image-Processing Bar CodeReading Subsystem (e.g. image processor) analyzes and measures inreal-time the spatial intensity distribution of the captured image anddetermines whether or not a corrected illumination duration is requiredor desired when capturing the next or subsequent frames of image data,during the current or subsequent image capture cycle.

As indicated at Block D in FIG. 36, within the Automatic Light ExposureMeasurement and Illumination Control Subsystem, the previouslydetermined illumination duration (used to captured the analyzed image)is automatically over-written with the corrected illumination duration(count) determined at Block C above.

As indicated at Block E in FIG. 36, the Automatic Light ExposureMeasurement and Illumination Control Subsystem then uses the correctedillumination duration (computed by the software-based IlluminationMetering Program) to drive the LED-based Illumination Subsystem andcapture a subsequent digital image of the illuminated object within thefield of view of the system.

As indicated in FIG. 36, the steps indicated at Blocks C through E canbe repeated a number of times in a recursive manner, each image capturecycle, to finally produce a digital image having an optimized spatialintensity level with excellent image contrast.

Hand-Supportable Image-Processing Based Bar Code Symbol Reader Employingan Image Cropping Zone (ICZ) Framing Pattern, and an AutomaticPost-Image Capture Cropping Method

The hand-held image-processing bar code symbol readers describedhereinabove employs a narrow-area illumination beam which provides avisual indication to the user on the vicinity of the narrow-area fieldof view of the system. However, while operating the system during itswide-area image capture modes of operation, it may be desirable inparticular applications to provide a visual indication of the wide-areafield of view of the system. While various techniques are known in theart to provide such targeting/marking functions, a novel method will bedescribed below with reference to FIGS. 37 through 39.

FIG. 37 shows a hand-supportable image-processing based bar code symbolreader employing an image cropping zone (ICZ) framing pattern, and anautomatic post-image capture cropping methods to abstract an ICZ withinwhich a targeted object to be imaged can be visually encompassed duringobject illumination and imaging operations. As shown in FIG. 38, thishand-supportable image-processing based bar code symbol reader issimilar to those designs described above, except that it includes one ormore image cropping zone (ICZ) illumination framing source(s) operatedunder the control of the System Control Subsystem. Preferably, these ICZframing sources are realized using four relative bright LEDs indicatingthe corners of the ICZ, which will be cropped during post-image captureoperations. Alternatively, the ICZ framing source could be a VLD thatproduces a visible laser diode transmitted through a light diffractiveelement (e.g. volume transmission hologram) to produce four beamletsindicating the corners of the ICZ, or bright lines that appear in thecaptured image. The ICZ frame created by such corner points or borderlines (formed thereby) can be located using edge-tracing algorithms, andthen the corners of the ROI can be identified from the traced borderlines.

Referring to FIG. 39, the ICZ Framing and Post-Image Capture CroppingProcess of the present invention will now be described.

As indicated at Block A in FIG. 39, the first step of the methodinvolves projecting an ICZ framing pattern within the FOV of the systemduring wide-area illumination and image capturing operations.

As indicated at Block B in FIG. 39, the second step of the methodinvolves the user visually aligning the object to be imaged within theICZ framing pattern (however it might be realized).

As indicated at Block C in FIG. 39, the third step of the methodinvolves the Image Formation and Detection Subsystem and the ImageCapture and Buffering Subsystem forming and capturing the wide-areaimage of the entire FOV of the system, which embraces (i.e. spatiallyencompasses) the ICZ framing pattern aligned about the object to beimaged.

As indicated at Block D in FIG. 39, the fourth step of the methodinvolves using an automatic software-based image cropping algorithm,implemented within the Image-Processing Bar Code Reading Subsystem, toautomatically crop the pixels within the spatial boundaries defined bythe ICZ, from those pixels contained in the entire wide-area image framecaptured at Block B. Due to the fact that image distortion may exist inthe captured image of the ICZ framing pattern, the cropped rectangularimage may partially contain the ICZ framing pattern itself and someneighboring pixels that may fall outside the ICZ framing pattern.

As indicated at Block E in FIG. 39, the fifth step of the methodinvolves the Image-Processing Bar Code Reading Subsystem automaticallydecode processing the image represented by the cropped image pixels inthe ICZ so as to read a 1 D or 2 D bar code symbol graphicallyrepresented therein.

As indicated at Block F in FIG. 39, the sixth step of the methodinvolves the Image-Processing Bar Code Reading Subsystem outputting (tothe host system) the symbol character data representative of the decodedbar code symbol.

Notably, in prior art FOV targeting methods, the user captures an imagethat is somewhat coinciding with what he intended to capture. Thissituation is analogous to a low-cost point-and-shoot camera, wherein thefield of view of the viewfinder and camera lens only substantiallycoincide with each other. In the proposed scheme employing theabove-described ICZ framing and post-processing pixel cropping method,the user captures an image that is exactly what s/he framed with the ICZframing pattern. The advantage of this system to prior art FOV methodsis analogous to the advantage of a SLR camera over a point-and-shootcamera, namely: accuracy and reliability.

Another advantage of using the ICZ framing and post-processing pixelcropping method is that the ICZ framing pattern (however realized) doesnot have to coincide with the field of view of the Image Formation AndDetection Subsystem. The ICZ framing pattern also does not have to haveparallel optical axes. The only basic requirement of this method is thatthe ICZ framing pattern fall within the field of view (FOV) of the ImageFormation And Detection Subsystem, along the working distance of thesystem.

However, one may design the ICZ framing pattern and the optical axisangle of the system such that when the ICZ framing pattern does not fallcompletely inside the camera's field of view (i.e. the ICZ framingpattern does not fall within the complete acquired image), this visuallyimplies to the user that the captured and cropped image is outside thedepth of focus of the imaging system. Thus, the imager can provide avisual or audio feedback to the user so that he may repeat the imageacquisition process at a more appropriate distance.

Some Modifications which Readily Come to Mind

In alternative embodiments of the present invention, illumination arrays27, 28 and 29 employed within the Multi-Mode Illumination Subsystem 14may be realized using solid-state light sources other than LEDs, suchas, for example, visible laser diode (VLDs) taught in great detail inWIPO Publication No. WO 02/43195 A2, published on May 30, 2002, assignedto Metrologic Instruments, Inc., and incorporated herein by reference inits entirety as if set forth fully herein. However, when using VLD-basedillumination techniques in the imaging-based bar code symbol reader ofthe present invention, great care must be taken to eliminate orotherwise substantially reduce speckle-noise generated at the imagedetection array 22 when using coherent illumination source during objectillumination and imaging operations. WIPO Publication No. WO 02/43195A2, supra, provides diverse methods of and apparatus for eliminating orsubstantially reducing speckle-noise during image formation anddetection when using VLD-based illumination arrays.

While CMOS image sensing array technology was described as being used inthe preferred embodiments of the present invention, it is understoodthat in alternative embodiments, CCD-type image sensing arraytechnology, as well as other kinds of image detection technology, can beused.

The bar code reader design described in great detail hereinabove can bereadily adapted for use as an industrial or commercial fixed-positionbar code reader/imager, having the interfaces commonly used in theindustrial world, such as Ethernet TCP/IP for instance. By providing thesystem with an Ethernet TCP/IP port, a number of useful features will beenabled, such as, for example: multi-user access to such bar codereading systems over the Internet; control of multiple bar code readingsystem on the network from a single user application; efficient use ofsuch bar code reading systems in live video operations; web-servicing ofsuch bar code reading systems, i.e. controlling the system or a networkof systems from an Internet Browser; and the like.

While the illustrative embodiments of the present invention have beendescribed in connection with various types of bar code symbol readingapplications involving 1-D and 2-D bar code structures, it is understoodthat the present invention can be use to read (i.e. recognize) anymachine-readable indicia, dataform, or graphically-encoded form ofintelligence, including, but not limited to bar code symbol structures,alphanumeric character recognition strings, handwriting, and diversedataforms currently known in the art or to be developed in the future.Hereinafter, the term “code symbol” shall be deemed to include all suchinformation carrying structures and other forms of graphically-encodedintelligence.

Also, imaging-based bar code symbol readers of the present invention canalso be used to capture and process various kinds of graphical imagesincluding photos and marks printed on driver licenses, permits, creditcards, debit cards, or the like, in diverse user applications.

It is understood that the image capture and processing technologyemployed in bar code symbol reading systems of the illustrativeembodiments may be modified in a variety of ways which will becomereadily apparent to those skilled in the art of having the benefit ofthe novel teachings disclosed herein. All such modifications andvariations of the illustrative embodiments thereof shall be deemed to bewithin the scope and spirit of the present invention as defined by theClaims to Invention appended hereto.

1. A method of reading bar code symbols using a hand-supportableimage-processing based bar code symbol reading system having an imagesensing array with a field of view (FOV), an LED-based illuminationsubsystem with an LED illumination array, a wide-area illumination andimage capturing mode of operation, and an automatic software-based imagecropping algorithm, said method comprising the steps of: (a) projectingan image cropping zone (ICZ) framing pattern within the FOV of saidimage sensing array during said wide-area illumination and imagecapturing mode of operation; (b) a user visually aligning an object tobe imaged within said ICZ framing pattern; (c) simultaneously projectingan illumination pattern from said LED illumination array onto the objectin said FOV while projecting said ICZ framing pattern within said FOV,and forming and detecting a wide-area digital image of the entire FOV ofsaid image sensing array, which spatially encompasses said ICZ framingpattern aligned about at least a portion of the object to be imaged; (d)using said automatic software-based image cropping algorithm toautomatically locate said ICZ framing pattern in said wide-area digitalimage of the entire said FOV, by tracing corner points or border linesthat identify boundaries of said ICZ framing pattern, and cropping theimage pixels within the spatial boundaries of said ICZ framing pattern,prior to performing decode-processing operations, to provide a croppeddigital image; and (e) automatically decode processing the croppeddigital image represented by the cropped image pixels in said ICZframing pattern so as to read a 1 D or 2 D bar code symbol graphicallyrepresented in said cropped digital image.
 2. The method of claim 1,which further comprises: (f) outputting to a host system, the symbolcharacter data representative of the decoded 1 D or 2 D bar code symbol.3. The method of claim 1, wherein step (a) comprising generating a laserbeam which is transmitted through a light diffractive element to producea plurality of laser beamlets that define the spatial boundaries of saidICZ framing pattern for the user to see during bar code illumination andimaging operations.
 4. A hand-supportable image-processing based barcode symbol reading system having a wide-area illumination and imagecapturing mode of operation, said hand-supportable image-processingbased bar code symbol reading system comprising: a hand-supportablehousing; an image sensing array with a field of view (FOV), disposedwithin said hand-supportable housing; an LED-based illuminationsubsystem with an LED illumination array, disposed within saidhand-supportable housing; an image processor, disposed within saidhand-supportable housing, programmed to carry out an automaticsoftware-based image cropping algorithm; an optics-based mechanism,disposed within said hand-supportable housing, for simultaneouslyprojecting an image cropping zone (ICZ) framing pattern within said FOV,while said LED illumination array projects illumination onto an objectin said FOV, during said wide-area illumination and image capturing modeof operation; and an image-processing based bar code symbol readingmodule disposed within said hand-supportable housing; whereby, when auser visually aligns the object to be imaged within said ICZ framingpattern, said LED illumination array projects illumination onto saidobject in said FOV while said optics-based mechanism projects said ICZframing pattern onto at least a portion of the object in said FOV, andsaid image sensing array detects a wide-area digital image of the entireFOV so that the detected wide-area digital image spatially encompassessaid ICZ framing pattern aligned about the object to be imaged; thensaid automatic software-based image cropping algorithm is used toautomatically locate said ICZ framing pattern in said wide-area digitalimage of the entire said FOV, by tracing corner points or border linesthat identify boundaries of said ICZ framing pattern, and cropping theimage pixels within the spatial boundaries of said ICZ framing pattern,prior to performing decode-processing operations, to provide a croppeddigital image; then the cropped digital image represented by the croppedimage pixels in said ICZ framing pattern is automaticallydecode-processed by said image-processing based bar code symbol readingmodule so as to read a 1 D or 2 D bar code symbol graphicallyrepresented in the cropped digital image; and then the symbol characterdata representative of the decoded 1 D or 2 D bar code symbol isoutputted to a host system.
 5. The hand-supportable image-processingbased bar code symbol reading system of claim 4, wherein said anoptics-based mechanism comprises a laser source for generating a visiblelaser beam which is transmitted through a light diffractive element soas to produce a plurality of laser beamlets that define the spatialboundaries of said ICZ framing pattern for the user to see during objectillumination and imaging operations.